-- Logs begin at Thu 2022-06-23 12:55:24 UTC, end at Thu 2022-06-23 13:57:36 UTC. -- Jun 23 13:30:56.088033 dv-cinder-815582-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 23 13:30:56.096553 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 23 13:30:56.098584 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 13:30:56 2022] *** Jun 23 13:30:56.098584 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 13:30:56.098584 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 13:30:56.098584 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: nodename: dv-cinder-815582-10-iscsi Jun 23 13:30:56.098584 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: machine: x86_64 Jun 23 13:30:56.098584 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: clock source: unix Jun 23 13:30:56.098584 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: pcre jit disabled Jun 23 13:30:56.098584 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: detected number of CPU cores: 4 Jun 23 13:30:56.098584 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: current working directory: / Jun 23 13:30:56.098584 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: detected binary path: /usr/bin/uwsgi-core Jun 23 13:30:56.098584 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: your processes number limit is 47680 Jun 23 13:30:56.098584 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: your memory page size is 4096 bytes Jun 23 13:30:56.098584 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: detected max file descriptor number: 2048 Jun 23 13:30:56.098584 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: lock engine: pthread robust mutexes Jun 23 13:30:56.099525 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: thunder lock: enabled Jun 23 13:30:56.099525 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 23 13:30:56.099525 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 13:30:56.147546 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: Python main interpreter initialized at 0x561eae86c9c0 Jun 23 13:30:56.147546 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: python threads support enabled Jun 23 13:30:56.147546 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: your server socket listen backlog is limited to 100 connections Jun 23 13:30:56.147546 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: your mercy for graceful operations on workers is 90 seconds Jun 23 13:30:56.147950 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 13:30:56.147950 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: *** Operational MODE: preforking *** Jun 23 13:30:56.148253 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: *** uWSGI is running in multiple interpreter mode *** Jun 23 13:30:56.148253 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: spawned uWSGI master process (pid: 109798) Jun 23 13:30:56.148470 dv-cinder-815582-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 23 13:30:56.152340 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: spawned uWSGI worker 1 (pid: 109799, cores: 1) Jun 23 13:30:56.152340 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: spawned uWSGI worker 2 (pid: 109800, cores: 1) Jun 23 13:30:56.152340 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 13:30:56.793570 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 13:30:56.800364 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 13:30:57.904588 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 13:30:57.904588 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: from cryptography.utils import int_from_bytes Jun 23 13:30:57.905210 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 13:30:57.905210 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: from cryptography.utils import int_from_bytes Jun 23 13:30:57.908255 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 13:30:57.908255 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: from cryptography.utils import int_from_bytes Jun 23 13:30:57.908739 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 13:30:57.908739 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: from cryptography.utils import int_from_bytes Jun 23 13:31:00.344046 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 13:31:00.344636 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 13:31:00.344723 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 13:31:00.344723 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 13:31:00.345125 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 13:31:00.345125 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 13:31:00.345293 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 13:31:00.345369 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 13:31:00.345545 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 13:31:00.345767 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.345937 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 13:31:00.346066 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.346164 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.346412 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.346545 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.346708 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.346818 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.347062 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.347208 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.347368 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.347481 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.347711 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.347859 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.348027 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.348181 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.348328 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.348432 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.348591 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.348699 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.348930 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.349065 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.349246 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.349403 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-10-iscsi {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.349540 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.349653 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-10-iscsi {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.349868 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.350003 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.350160 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.350271 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.350466 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.350557 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.350774 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.350862 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.351080 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.351187 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.351399 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.351549 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.351706 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.351894 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.352213 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.352351 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.352517 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.352639 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.352820 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.352955 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.353290 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.353400 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.353480 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.353616 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.353768 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.353955 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.354077 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.354256 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.354385 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.354549 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.354687 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.354874 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.355006 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.355184 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.355313 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.355612 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-10-iscsi {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.355743 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-10-iscsi {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.355933 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.356084 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.356245 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.356369 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.356561 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.356681 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.356972 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.357124 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.357337 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.357491 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.357649 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.357801 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.357971 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.358171 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.358296 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.358447 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.358606 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.358737 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.358934 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.359060 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.359254 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.359396 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.359600 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.359772 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.359922 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.360008 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.360226 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.360311 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.360544 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.360629 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.360852 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.360944 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.361169 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.361253 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.361476 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.361594 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.361777 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.361859 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.362024 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.362105 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.362328 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.362411 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.362647 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.362737 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.362966 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.363061 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.363282 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.363410 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.363555 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.363647 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.363802 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.363898 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.364115 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.364206 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.364431 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.364515 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.364737 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.364821 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.365041 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.365123 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.365364 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.365455 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.365646 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.365737 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.365950 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.366032 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.366251 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.366344 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.366553 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.366637 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.366855 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.366937 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.367169 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.367260 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.367506 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.367601 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.367825 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.367908 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.368133 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.368227 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.368448 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.368530 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.368839 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.368920 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.369086 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.369182 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.369389 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.369471 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.369722 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.369812 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.370037 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.370128 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.370343 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.370427 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.370657 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.370747 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.370974 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.371067 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.371277 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.371390 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.371611 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.371747 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.371916 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.372009 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.372233 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.372324 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.372562 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.372652 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.372892 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.372978 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.373141 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.373232 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.373439 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.373529 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.373741 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.373832 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.374054 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.374144 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.374356 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.374447 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.374659 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.374748 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.374961 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.375044 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.375258 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.375379 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.375589 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.375679 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.375894 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.375980 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.376196 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.376329 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.376500 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.376583 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.376802 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.376884 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.377106 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.377197 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.377410 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.377493 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.377714 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.377796 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.378017 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.378108 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.378330 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.378419 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.378645 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.378736 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.378949 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.379035 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.379252 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.379360 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.379582 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.379681 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.379885 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.379977 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.380203 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.380294 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.380508 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.380605 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.380811 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.380903 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.381130 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.381212 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.381434 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.381517 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.381737 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.381828 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.382052 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.382135 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.382356 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.382457 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.382657 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.382741 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.382968 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.383051 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.383266 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.383375 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.383595 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.383681 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.383910 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.384002 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.384213 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.384297 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.384517 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.384602 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.384820 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.384918 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.385120 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.385211 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.385420 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.385504 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.385721 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.385811 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.386020 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.386203 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.386319 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.386437 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.386616 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.386697 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.386929 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.387019 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.387247 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.387384 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.387578 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.387659 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.387883 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.387977 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.388186 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.388280 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.388556 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.388650 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:31:00.388892 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.388984 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.389222 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.389304 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.389557 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.389639 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.389870 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.389961 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.390202 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.390295 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.390526 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.390615 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.390844 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.390927 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.391153 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.391234 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.391491 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.391577 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.391814 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.391940 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.392126 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.392210 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.392435 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.392525 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.392745 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.392829 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.393061 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.393143 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.393375 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.393487 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.393700 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.393785 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.394013 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.394096 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.394328 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.394409 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.394642 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.394728 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.394952 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.395046 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.395268 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.395378 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.395621 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.395705 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.395942 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.396025 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.396252 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.396343 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.396588 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.396679 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.396929 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.397012 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.397235 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.397326 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.397558 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.397649 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.397876 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.397959 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.398185 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.398269 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.398495 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.398576 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.398804 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.398886 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.399125 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.399209 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.399478 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.399566 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.399791 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.399885 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.400106 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.400189 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.400418 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.400509 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.400729 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.400813 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.401037 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.401128 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.401345 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.401435 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.401649 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.401733 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.401982 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.402074 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.402295 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.402377 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.402604 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.402695 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.402915 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.402997 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.403230 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.403409 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.403567 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.403662 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.403877 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.403960 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.404244 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.404331 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.404547 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.404638 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.404849 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.404932 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.405150 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.405234 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.405458 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.405550 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.405759 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.405850 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.406074 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.406158 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.406400 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.406484 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.406704 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.406837 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.407030 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.407169 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.407362 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.407494 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.407666 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.407800 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.407975 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.408115 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.408287 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.408420 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.408591 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.408729 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.408900 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.408987 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.409207 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.409341 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.409510 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.409647 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.409830 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.409970 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.410140 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.410272 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.410443 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.410575 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.410764 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.410903 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.411070 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.411200 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.411395 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.411536 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.411705 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.411865 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.412006 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.412136 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.412309 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.412402 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.412615 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.412707 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.412922 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.413005 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.413240 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.413324 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.413548 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.413632 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.413856 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.413946 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.414187 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.414270 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.414514 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.414597 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.414816 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.414898 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.415136 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.415218 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.415484 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.415575 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.415798 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.415893 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.416099 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.416193 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.416406 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.416499 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.416708 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.416790 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.417010 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.417105 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.417310 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.417394 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.417616 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.417699 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.417914 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.418005 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.418213 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.418296 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.418513 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.418604 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.418810 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.418906 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.419109 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.419192 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.419452 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.419540 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.419786 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.419880 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.420086 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.420170 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.420384 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.420467 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.420689 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.420774 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.421027 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.421110 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.421332 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.421414 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.421666 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.421752 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.421996 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.422086 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.422308 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.422395 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.422629 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.422721 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.422939 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.423026 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.423250 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.423352 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.423583 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.423667 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.423892 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.423976 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.424199 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.424290 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.424506 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.424590 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.424822 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.424905 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.425129 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.425221 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.425443 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.425530 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.425752 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.425835 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.426068 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.426160 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.426374 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.426457 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.426687 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.426771 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.426990 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.427133 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.427299 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.427473 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.427655 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.427795 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.427985 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.428133 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.428279 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.428409 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.428598 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.428733 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.428903 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.429044 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.429213 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.429341 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.429519 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.429647 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.429826 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.429954 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.430133 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.430273 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.430439 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.430568 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.430755 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.430883 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.431061 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.431189 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.431396 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.431527 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.431706 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.431851 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.432022 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.432162 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.432329 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.432457 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.432644 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.432729 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.432943 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.433034 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.433256 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.433352 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.433579 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.433662 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.433909 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.434028 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.434216 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.434314 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.434525 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.434609 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.434843 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.434924 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.435149 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.435243 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.435555 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.435641 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.435872 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.435958 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.436175 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.436266 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.436480 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.436564 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.436791 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.436882 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.437104 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.437199 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.437413 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.437496 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.437722 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.437805 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.438024 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.438117 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.438337 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.438430 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.438641 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.438724 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.438945 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.439029 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.439242 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.439409 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.439577 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.439672 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.439896 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.439980 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.440203 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.440293 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.440524 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.440617 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.440844 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.440935 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.441145 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.441234 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.441448 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.441539 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.441764 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.441848 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.442073 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.442155 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.442374 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.442469 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.442676 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.442760 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.442982 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.443067 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.443317 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.443507 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.443647 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.443731 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.443946 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.444037 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.444261 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.444346 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.444583 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.444672 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.444892 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.444982 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.445205 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.445290 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.445516 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.445599 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.445826 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.445912 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.446144 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.446228 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.446457 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.446539 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.446763 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.446847 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.447072 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.447156 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.447404 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.447501 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.447714 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.447812 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.448022 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.448105 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.448339 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.448430 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.448648 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.448746 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.448959 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.449042 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.449265 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.449348 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.449570 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.449699 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.449879 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.449968 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.450203 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.450291 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.450769 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.450864 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.451128 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.451223 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.451470 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.451559 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.451794 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.451882 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.452115 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.452210 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.452432 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.452536 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.452760 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.452856 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.453087 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.453174 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.453436 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.453532 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.453739 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.453835 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.454048 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.454142 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.454350 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.454443 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.454653 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.454740 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.454963 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.455050 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.455267 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.455393 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.455595 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.455697 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.455901 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.455988 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.456210 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.456297 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.456512 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.456596 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.456813 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.456907 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.457116 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.457261 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.457416 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.457544 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.457730 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.457870 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.458031 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.458172 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.458339 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.458490 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.458643 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.458783 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.458963 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.459096 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.459269 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.459452 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.459588 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.459724 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.459888 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.459972 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.460187 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.460279 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.460526 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.460609 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.460828 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.460911 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.461164 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.461261 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.461807 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.461909 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.462143 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.462225 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.462445 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.462538 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.462751 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.462845 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.463070 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.463152 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.463392 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.463479 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.463698 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.463783 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.463999 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.464081 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.464310 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.464394 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.464614 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.464697 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.464915 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.464998 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.465225 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.465315 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.465532 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.465622 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.465839 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.465930 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.466146 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.466229 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.466464 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.466575 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.466804 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.466897 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.467110 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.467196 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.467450 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.467545 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.467760 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.467859 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.468062 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.468147 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.468364 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.468446 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.468672 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.468764 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.468980 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.469076 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.469280 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.469363 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.469589 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.469681 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.469891 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.469983 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.470203 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.470285 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.470508 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.470601 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.470810 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.470894 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.471110 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.471192 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.471442 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.471530 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.471757 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.471840 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.472059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.472142 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.472378 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.472462 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.472685 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.472782 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.472990 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.473093 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.473290 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.473374 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.473594 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.473685 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.473897 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.473989 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.474197 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.474281 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.474505 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.474587 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.474821 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.474912 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.475136 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.475228 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.475467 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.475575 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.475788 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.475909 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.476093 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.476194 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.476396 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.476489 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.476698 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.476784 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.477007 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.477091 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.477312 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.477417 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.477610 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.477696 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.477911 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.477994 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.478212 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.478304 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.478512 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.478596 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.478830 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.478921 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.479136 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.479220 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.479463 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.479553 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.479777 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.479862 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.480078 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.480230 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.480417 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.480557 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.480718 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.480851 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.481074 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.481216 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.481375 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.481501 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.481689 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.481821 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.482007 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.482166 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.482344 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.482476 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.482790 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.482918 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.483150 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.483322 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.483491 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.483811 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.483938 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.484122 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.484406 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.484534 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.484725 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.484980 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.485111 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.485335 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.485479 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.485647 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.485776 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.486375 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.486508 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.486637 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.486778 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.486907 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.486907 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.487149 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.487295 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.487433 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.487518 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.487711 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.487797 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.488081 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.488168 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.488391 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.488655 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.488747 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.488997 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.489205 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.489291 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.489604 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.489747 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.489916 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.490264 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.490377 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.490503 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.490595 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.490814 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.490909 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.491122 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.491210 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.491449 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.491552 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.491771 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.491865 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.492080 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.492166 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.492382 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.492551 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.492691 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.492782 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.492993 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.493078 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.493306 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.493404 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.493606 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.493698 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.493915 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.494034 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.494246 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.494331 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.494562 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.494645 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.494872 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.494999 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.495186 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.495272 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.495518 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.495615 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.495834 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.495920 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.496144 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.496230 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.496449 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.496574 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.496888 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.496980 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.497260 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.497345 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.497571 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.497655 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.497944 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.498041 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.498261 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.498347 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.498575 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.498659 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.498889 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.498982 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.499195 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.499287 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.499532 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.499641 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.499840 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.499973 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.500147 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.500253 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.500475 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.500568 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.500782 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.500867 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.501110 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.501194 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.501453 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.501535 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.501777 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.501863 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.502084 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.502168 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.502390 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.502524 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.502697 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.502839 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.503019 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.503159 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.503329 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.503496 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.503670 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.503824 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.504091 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.504179 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.504407 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.504504 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.504719 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.504804 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.505037 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.505122 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.505362 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.505458 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.505687 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.505795 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.506000 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.506088 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.506315 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.506408 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.506625 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.506721 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.506947 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.507038 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.507259 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.507376 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.507617 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.507718 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.507923 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.508017 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.508244 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.508329 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.508556 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.508652 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.508871 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.508959 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.509178 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.509264 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.509501 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.509590 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.509823 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.509909 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.510139 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.510252 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.510454 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.510558 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.510758 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.510869 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.511062 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.511193 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.511408 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.511528 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.511716 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.511854 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.512032 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.512184 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.512343 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.512493 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.512654 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.512800 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.512958 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.513114 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.513261 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.513449 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.513619 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.513756 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.513925 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.514083 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.514249 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.514389 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.514564 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.514703 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.514888 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.515018 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.515209 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.515350 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.515543 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.515655 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.515866 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.515965 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.516175 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.516261 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.516481 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.516575 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.516784 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.516880 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.517088 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.517183 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.517430 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.517517 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.517736 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.517821 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.518059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.518153 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.518379 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.518474 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.518689 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.518784 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.518996 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.519091 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.519301 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.519419 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.519629 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.519719 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.519965 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.520049 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.520273 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.520377 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.520597 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.520692 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.520898 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.520993 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.521203 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.521297 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.521517 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.521604 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.521823 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.521917 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.522137 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.522278 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.522425 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.522512 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.522733 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.522820 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.523035 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.523131 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.523357 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.523449 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.523663 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.523761 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.523986 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.524074 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.524292 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.524378 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.524593 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.524678 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.524899 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.524994 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.525203 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.525291 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.525507 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.525594 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.525808 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.525895 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.526109 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.526194 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.526432 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.526526 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.526737 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.526835 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.527060 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.527182 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.527394 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.527498 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.527705 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.527792 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.528012 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.528101 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.528317 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.528446 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.528637 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.528724 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.528976 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.529096 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.529325 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.529426 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.529642 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.529729 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.529957 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.530046 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.530279 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.530426 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.530589 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.530685 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.530897 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.530999 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.531211 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.531306 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.531551 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.531646 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.531868 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.531961 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.532185 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.532390 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.532485 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.532722 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.532826 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.533039 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.533143 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.533355 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.533456 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.533669 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.533763 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.533983 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.534087 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.534295 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.534390 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.534606 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.534816 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.534917 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.535146 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.535240 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.535541 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.535646 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.535862 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.535972 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.536177 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.536332 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.536475 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.536614 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.536790 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.536932 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.537104 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.537255 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.537417 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.537548 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.537729 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.537863 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.538070 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.538215 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.538348 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.538478 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.538665 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.538800 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.538972 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.539105 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.539284 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.539480 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.539624 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.539710 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.539936 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.540023 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.540252 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.540346 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.540561 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.540650 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.540873 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.540957 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.541186 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.541281 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.541496 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.541580 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.541804 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.541889 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.542116 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.542209 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.542431 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.542515 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.542742 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.542826 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.543056 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.543142 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.543389 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.543478 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.543705 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.543803 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.544018 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.544101 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.544330 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.544418 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.544669 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.544874 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.544984 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.545196 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.545310 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.545532 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.545647 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.545860 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.545969 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.546187 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.546272 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.546506 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.546590 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.546825 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.546920 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.547153 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.547412 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.547502 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.547740 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.547827 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.548080 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.548195 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.548390 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.548479 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.548695 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.548784 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.549017 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.549103 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.549329 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.549424 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.549634 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.549722 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.549950 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.550037 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.550256 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.550343 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.550573 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.550785 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.550877 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.551133 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.551230 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.551483 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.551574 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.551809 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.551896 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.552111 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.552196 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.552433 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.552522 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.552737 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.552823 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.553059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.553265 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.553361 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.553610 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.553696 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.553928 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.554014 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.554253 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.554339 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.554557 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.554644 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.554862 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.554956 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.555170 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.555256 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.555502 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.555589 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.555808 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.555896 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.556110 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.556197 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.556411 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.556496 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.556718 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.556803 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.557022 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.557110 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.557325 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.557437 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.557629 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.557732 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.557935 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.558029 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.558238 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.558324 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.558542 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.558637 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.558842 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.558928 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.559145 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.559230 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.559482 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.559587 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.559785 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.559870 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.560089 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.560176 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.560445 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.560545 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.560758 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.560846 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.561063 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.561149 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.561368 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.561454 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.561674 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.561760 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.561986 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.562072 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.562289 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.562376 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.562599 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.562685 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.562902 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.562987 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.563212 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.563301 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.563543 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.563630 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.563856 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.563943 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.564167 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.564255 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.564512 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.564608 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.564813 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.564934 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.565116 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.565351 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.565438 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.565685 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.565785 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.566004 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.566092 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.566331 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.566424 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.566638 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.566725 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.566952 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.567039 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.567259 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.567374 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.567612 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.567895 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.567992 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.568228 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.568314 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.568539 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.568636 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.568851 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.568940 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.569165 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.569252 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.569471 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.569564 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.569777 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.569865 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.570081 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.570167 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.570390 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.570483 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.570702 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.570790 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.571013 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.571103 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.571322 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.571427 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.571655 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.571744 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.571965 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.572052 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.572276 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.572370 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.572584 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.572670 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.572893 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.572980 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.573206 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.573302 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.573515 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.573609 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.573827 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.573914 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.574134 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.574228 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.574439 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.574524 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.574747 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.574834 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.575056 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.575143 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.575402 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.575494 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.575723 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.575811 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.576059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.576161 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.576367 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.576455 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.576674 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.576782 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.576984 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.577080 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.577294 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.577389 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.577604 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.577738 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.577922 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.578010 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.578249 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.578337 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.578562 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.578667 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.578868 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.578955 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.579227 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.579312 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.579574 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.579674 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.579908 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.579994 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.580226 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.580319 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.580535 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.580624 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.580863 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.580950 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.581166 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.581253 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.581474 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.581562 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.581780 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.581868 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.582090 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.582183 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.582405 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.582491 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.582715 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.582808 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.583020 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.583115 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.583322 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.583438 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.583658 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.583746 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.583961 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.584061 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.584264 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.584350 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.584567 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.584652 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.584868 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.584963 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.585178 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.585281 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.585483 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.585570 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.585783 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.585877 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.586083 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.586169 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.586698 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.586790 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.587007 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.587095 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.587309 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.587476 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.587634 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.587719 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.587937 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.588026 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.588235 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.588320 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.588536 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.588656 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.588840 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.588928 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.589140 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.589225 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.589442 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.589528 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.589747 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.589834 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.590057 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.590151 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.590357 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.590468 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.590664 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.590751 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.590968 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.591053 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.591271 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.591423 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.591653 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.591745 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.591984 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.592080 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.592317 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.592414 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.592627 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.592713 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.592946 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.593041 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.593257 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.593352 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.593570 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.593656 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.593877 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.593964 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.594188 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.594283 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.594502 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.594590 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.594812 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.594905 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.595121 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.595256 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.595478 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.595568 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.595784 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.595871 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.596094 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.596182 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.596405 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.596493 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.596718 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.596815 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.597028 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.597116 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.597338 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.597423 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.597661 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.597754 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.597971 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.598057 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.598278 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.598372 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.598593 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.598732 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.598905 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.598994 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.599217 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.599305 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.599563 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.599654 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.599884 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.599971 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.600212 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.600305 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.600525 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.600612 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.600837 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.600930 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.601151 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.601246 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.601460 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.601548 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.601769 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.601857 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.602086 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.602172 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.602403 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.602499 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.602728 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.602814 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.603042 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.603136 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.603372 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.603475 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.603676 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.603770 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.603921 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 13:31:00.604017 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.604334 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.604645 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.604986 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.605313 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.605625 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.605935 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.606238 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:31:00.606480 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109799) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 13:31:00.757685 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO dbcounter [None req-666bac64-0afc-40aa-8868-158bb82ec33d None None] Registered counter for database nova_api Jun 23 13:31:00.760479 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO dbcounter [None req-0370ab9a-821a-47e2-9a36-43a22162be3c None None] Registered counter for database nova_api Jun 23 13:31:00.780646 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG oslo_db.sqlalchemy.engines [None req-666bac64-0afc-40aa-8868-158bb82ec33d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109800) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 13:31:00.782267 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG oslo_db.sqlalchemy.engines [None req-0370ab9a-821a-47e2-9a36-43a22162be3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109799) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 13:31:00.787910 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG dbcounter [-] [109800] Writer thread running {{(pid=109800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 13:31:00.788747 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG dbcounter [-] [109799] Writer thread running {{(pid=109799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 13:31:00.845083 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.context [None req-666bac64-0afc-40aa-8868-158bb82ec33d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0(cell1) {{(pid=109800) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 13:31:00.845470 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.context [None req-0370ab9a-821a-47e2-9a36-43a22162be3c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0(cell1) {{(pid=109799) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 13:31:00.849074 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG oslo_concurrency.lockutils [None req-666bac64-0afc-40aa-8868-158bb82ec33d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:31:00.849400 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG oslo_concurrency.lockutils [None req-0370ab9a-821a-47e2-9a36-43a22162be3c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:31:00.850670 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG oslo_concurrency.lockutils [None req-666bac64-0afc-40aa-8868-158bb82ec33d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:31:00.851008 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG oslo_concurrency.lockutils [None req-0370ab9a-821a-47e2-9a36-43a22162be3c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:31:00.851504 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG oslo_concurrency.lockutils [None req-666bac64-0afc-40aa-8868-158bb82ec33d None None] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:31:00.851833 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG oslo_concurrency.lockutils [None req-0370ab9a-821a-47e2-9a36-43a22162be3c None None] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:31:00.853474 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG oslo_concurrency.lockutils [None req-666bac64-0afc-40aa-8868-158bb82ec33d None None] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:31:00.853806 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG oslo_concurrency.lockutils [None req-0370ab9a-821a-47e2-9a36-43a22162be3c None None] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:31:00.855527 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO dbcounter [None req-666bac64-0afc-40aa-8868-158bb82ec33d None None] Registered counter for database nova_cell0 Jun 23 13:31:00.855853 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO dbcounter [None req-0370ab9a-821a-47e2-9a36-43a22162be3c None None] Registered counter for database nova_cell0 Jun 23 13:31:00.860019 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO dbcounter [None req-0370ab9a-821a-47e2-9a36-43a22162be3c None None] Registered counter for database nova_cell1 Jun 23 13:31:00.860540 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO dbcounter [None req-666bac64-0afc-40aa-8868-158bb82ec33d None None] Registered counter for database nova_cell1 Jun 23 13:31:00.867891 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG oslo_db.sqlalchemy.engines [None req-0370ab9a-821a-47e2-9a36-43a22162be3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109799) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 13:31:00.869204 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG oslo_db.sqlalchemy.engines [None req-0370ab9a-821a-47e2-9a36-43a22162be3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109799) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 13:31:00.871086 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG oslo_db.sqlalchemy.engines [None req-666bac64-0afc-40aa-8868-158bb82ec33d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109800) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 13:31:00.872481 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG oslo_db.sqlalchemy.engines [None req-666bac64-0afc-40aa-8868-158bb82ec33d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109800) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 13:31:00.876263 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG dbcounter [-] [109799] Writer thread running {{(pid=109799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 13:31:00.878005 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG dbcounter [-] [109799] Writer thread running {{(pid=109799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 13:31:00.879257 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG dbcounter [-] [109800] Writer thread running {{(pid=109800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 13:31:00.880708 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG dbcounter [-] [109800] Writer thread running {{(pid=109800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 13:31:01.023261 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO dbcounter [None req-0370ab9a-821a-47e2-9a36-43a22162be3c None None] Registered counter for database nova_cell0 Jun 23 13:31:01.027527 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO dbcounter [None req-666bac64-0afc-40aa-8868-158bb82ec33d None None] Registered counter for database nova_cell0 Jun 23 13:31:01.032801 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG oslo_db.sqlalchemy.engines [None req-0370ab9a-821a-47e2-9a36-43a22162be3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109799) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 13:31:01.037077 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG oslo_db.sqlalchemy.engines [None req-666bac64-0afc-40aa-8868-158bb82ec33d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109800) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 13:31:01.038163 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG dbcounter [-] [109799] Writer thread running {{(pid=109799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 13:31:01.042165 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG dbcounter [-] [109800] Writer thread running {{(pid=109800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 13:31:01.373320 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: WARNING keystonemiddleware.auth_token [None req-0370ab9a-821a-47e2-9a36-43a22162be3c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 13:31:01.380572 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: WARNING keystonemiddleware.auth_token [None req-0370ab9a-821a-47e2-9a36-43a22162be3c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 13:31:01.382149 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: WARNING keystonemiddleware.auth_token [None req-666bac64-0afc-40aa-8868-158bb82ec33d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 13:31:01.389539 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: WARNING keystonemiddleware.auth_token [None req-666bac64-0afc-40aa-8868-158bb82ec33d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 13:31:01.717256 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: WARNING keystonemiddleware.auth_token [None req-0370ab9a-821a-47e2-9a36-43a22162be3c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 13:31:01.723316 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: WARNING keystonemiddleware.auth_token [None req-0370ab9a-821a-47e2-9a36-43a22162be3c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 13:31:01.728384 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: WARNING keystonemiddleware.auth_token [None req-666bac64-0afc-40aa-8868-158bb82ec33d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 13:31:01.728608 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561eae86c9c0 pid: 109799 (default app) Jun 23 13:31:01.730671 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-0370ab9a-821a-47e2-9a36-43a22162be3c None None] Calling method '>' {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:31:01.731873 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-0370ab9a-821a-47e2-9a36-43a22162be3c None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001757 Jun 23 13:31:01.732677 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Thu Jun 23 13:31:01 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:31:01.734490 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: WARNING keystonemiddleware.auth_token [None req-666bac64-0afc-40aa-8868-158bb82ec33d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 13:31:01.740303 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561eae86c9c0 pid: 109800 (default app) Jun 23 13:32:16.438664 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-0370ab9a-821a-47e2-9a36-43a22162be3c None None] Calling method '>' {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:32:16.439695 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-0370ab9a-821a-47e2-9a36-43a22162be3c None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jun 23 13:32:16.440092 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 930 bytes} [Thu Jun 23 13:32:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:32:16.455893 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG dbcounter [-] [109800] Writing DB stats nova_api:SELECT=3 {{(pid=109800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:16.457710 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG dbcounter [-] [109800] Writing DB stats nova_cell0:SELECT=3 {{(pid=109800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:16.458539 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG dbcounter [-] [109800] Writing DB stats nova_cell1:SELECT=3 {{(pid=109800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:16.459365 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG dbcounter [-] [109800] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:16.895701 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-03ebafe1-7943-40d1-8f40-c0dc224272be admin admin] Calling method '>' {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:32:16.926203 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-03ebafe1-7943-40d1-8f40-c0dc224272be admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.479349 Jun 23 13:32:16.927054 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1291 bytes} [Thu Jun 23 13:32:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:32:18.957633 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-0370ab9a-821a-47e2-9a36-43a22162be3c None None] Calling method '>' {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:32:18.958624 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-0370ab9a-821a-47e2-9a36-43a22162be3c None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jun 23 13:32:18.959002 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 3/4] 10.222.0.26 () {54 vars in 930 bytes} [Thu Jun 23 13:32:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:32:19.021269 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-9f7ac623-3ed8-440b-ba20-a42ba08f26c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "ram": 256, "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "cirros256"}} {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:32:19.040263 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:32:19.040263 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: warnings.warn(msg) Jun 23 13:32:19.070242 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-9f7ac623-3ed8-440b-ba20-a42ba08f26c3 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.104507 Jun 23 13:32:19.077981 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 2/5] 10.222.0.26 () {64 vars in 1282 bytes} [Thu Jun 23 13:32:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 13:32:19.085359 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG dbcounter [-] [109799] Writing DB stats nova_api:SELECT=3 {{(pid=109799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:19.086516 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG dbcounter [-] [109799] Writing DB stats nova_cell1:SELECT=3 {{(pid=109799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:19.087975 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG dbcounter [-] [109799] Writing DB stats nova_cell0:SELECT=3 {{(pid=109799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:19.089021 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG dbcounter [-] [109799] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:32:19.291162 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-138d90ab-e901-458e-805f-e23fbc5a7a03 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:32:19.293626 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:32:19.293626 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: warnings.warn(msg) Jun 23 13:32:19.357764 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-138d90ab-e901-458e-805f-e23fbc5a7a03 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.277814 Jun 23 13:32:19.358272 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 4/6] 10.222.0.26 () {64 vars in 1335 bytes} [Thu Jun 23 13:32:19 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:32:21.408746 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-9f7ac623-3ed8-440b-ba20-a42ba08f26c3 admin admin] Calling method '>' {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:32:21.409778 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-9f7ac623-3ed8-440b-ba20-a42ba08f26c3 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Jun 23 13:32:21.410448 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 3/7] 10.222.0.26 () {54 vars in 930 bytes} [Thu Jun 23 13:32:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:32:21.533134 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-394ac4c5-dfea-4dc7-8134-57c4535eae70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 5, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "id": "d1"}} {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:32:21.551065 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:32:21.551065 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: warnings.warn(msg) Jun 23 13:32:21.571022 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-394ac4c5-dfea-4dc7-8134-57c4535eae70 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.154569 Jun 23 13:32:21.571619 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 5/8] 10.222.0.26 () {64 vars in 1282 bytes} [Thu Jun 23 13:32:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 13:32:21.583848 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-b486c3d1-f0ad-4249-9748-b27e99b44992 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:32:21.585801 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:32:21.585801 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: warnings.warn(msg) Jun 23 13:32:21.617975 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-b486c3d1-f0ad-4249-9748-b27e99b44992 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038212 Jun 23 13:32:21.618598 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 4/9] 10.222.0.26 () {64 vars in 1335 bytes} [Thu Jun 23 13:32:21 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:32:23.696535 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-394ac4c5-dfea-4dc7-8134-57c4535eae70 admin admin] Calling method '>' {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:32:23.697581 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-394ac4c5-dfea-4dc7-8134-57c4535eae70 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Jun 23 13:32:23.698191 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 930 bytes} [Thu Jun 23 13:32:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:32:23.783665 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-626f0432-d6e6-43fc-b150-a10520f5b765 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "ram": 1024, "rxtx_factor": 1.0, "id": "d2", "vcpus": 1, "name": "ds1G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:32:23.808343 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-626f0432-d6e6-43fc-b150-a10520f5b765 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.103821 Jun 23 13:32:23.816807 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 5/11] 10.222.0.26 () {64 vars in 1282 bytes} [Thu Jun 23 13:32:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 13:32:23.824261 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-9b33290a-5f4f-4fa6-ac1b-b03da97009ae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:32:23.861750 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-9b33290a-5f4f-4fa6-ac1b-b03da97009ae admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041945 Jun 23 13:32:23.867452 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 7/12] 10.222.0.26 () {64 vars in 1335 bytes} [Thu Jun 23 13:32:23 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:32:26.035905 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-626f0432-d6e6-43fc-b150-a10520f5b765 admin admin] Calling method '>' {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:32:26.036956 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-626f0432-d6e6-43fc-b150-a10520f5b765 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 Jun 23 13:32:26.043836 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 6/13] 10.222.0.26 () {54 vars in 930 bytes} [Thu Jun 23 13:32:26 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:32:26.132989 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-36764160-fd9f-4315-b284-d00ef47fcc5a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 2, "os-flavor-access:is_public": true, "name": "ds2G", "rxtx_factor": 1.0, "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3"}} {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:32:26.158109 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-36764160-fd9f-4315-b284-d00ef47fcc5a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.114745 Jun 23 13:32:26.166432 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 8/14] 10.222.0.26 () {64 vars in 1282 bytes} [Thu Jun 23 13:32:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 13:32:26.180585 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-2d29bd9a-3949-4904-8978-a0dd95a79b5c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:32:26.216852 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-2d29bd9a-3949-4904-8978-a0dd95a79b5c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047243 Jun 23 13:32:26.228742 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 7/15] 10.222.0.26 () {64 vars in 1335 bytes} [Thu Jun 23 13:32:26 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:32:28.342040 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-36764160-fd9f-4315-b284-d00ef47fcc5a admin admin] Calling method '>' {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:32:28.343696 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-36764160-fd9f-4315-b284-d00ef47fcc5a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002016 Jun 23 13:32:28.344269 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 9/16] 10.222.0.26 () {54 vars in 930 bytes} [Thu Jun 23 13:32:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:32:28.410765 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-5b7b53ff-5487-4567-94d0-499e0c8c782a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "vcpus": 4, "rxtx_factor": 1.0, "name": "ds4G", "os-flavor-access:is_public": true, "disk": 20, "id": "d4"}} {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:32:28.429427 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-5b7b53ff-5487-4567-94d0-499e0c8c782a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078964 Jun 23 13:32:28.430035 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 8/17] 10.222.0.26 () {64 vars in 1282 bytes} [Thu Jun 23 13:32:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 13:32:28.455906 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-38280fe1-710a-4c17-a4cd-6a0ad7c31b3e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:32:28.501825 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-38280fe1-710a-4c17-a4cd-6a0ad7c31b3e admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049519 Jun 23 13:32:28.502772 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 10/18] 10.222.0.26 () {64 vars in 1335 bytes} [Thu Jun 23 13:32:28 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:32:30.639227 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-5b7b53ff-5487-4567-94d0-499e0c8c782a admin admin] Calling method '>' {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:32:30.640980 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-5b7b53ff-5487-4567-94d0-499e0c8c782a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002211 Jun 23 13:32:30.641596 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 9/19] 10.222.0.26 () {54 vars in 930 bytes} [Thu Jun 23 13:32:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:32:30.718266 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-cc8a11e1-3e02-402a-9598-b4fce861ff4a admin admin] Calling method '>' {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:32:30.746027 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-cc8a11e1-3e02-402a-9598-b4fce861ff4a admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.098219 Jun 23 13:32:30.747401 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1291 bytes} [Thu Jun 23 13:32:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:32:32.874821 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-5b7b53ff-5487-4567-94d0-499e0c8c782a admin admin] Calling method '>' {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:32:32.876058 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-5b7b53ff-5487-4567-94d0-499e0c8c782a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001965 Jun 23 13:32:32.876460 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 10/21] 10.222.0.26 () {54 vars in 930 bytes} [Thu Jun 23 13:32:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:32:32.936457 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-3c8da9ac-7be9-4e03-ae9b-1170a33ea1cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "os-flavor-access:is_public": true, "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "id": "1"}} {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:32:32.955167 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-3c8da9ac-7be9-4e03-ae9b-1170a33ea1cc admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.072600 Jun 23 13:32:32.955922 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 12/22] 10.222.0.26 () {64 vars in 1282 bytes} [Thu Jun 23 13:32:32 2022] POST /compute/v2.1/flavors => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 13:32:32.968650 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-b9c01da3-cdd6-40f2-80b9-7e5417984017 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:32:32.991564 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-b9c01da3-cdd6-40f2-80b9-7e5417984017 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026660 Jun 23 13:32:32.992411 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 11/23] 10.222.0.26 () {64 vars in 1332 bytes} [Thu Jun 23 13:32:32 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:32:35.036315 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-3c8da9ac-7be9-4e03-ae9b-1170a33ea1cc admin admin] Calling method '>' {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:32:35.037325 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-3c8da9ac-7be9-4e03-ae9b-1170a33ea1cc admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 23 13:32:35.037759 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 930 bytes} [Thu Jun 23 13:32:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:32:35.098895 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-c69ed97b-bfff-4c3f-97ce-e4f08dfb8772 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "ram": 2048, "name": "m1.small", "disk": 20}} {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:32:35.118379 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-c69ed97b-bfff-4c3f-97ce-e4f08dfb8772 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074742 Jun 23 13:32:35.118982 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 12/25] 10.222.0.26 () {64 vars in 1282 bytes} [Thu Jun 23 13:32:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 13:32:35.130997 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-dd3da551-3666-4934-b2c5-54d7b63b3819 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:32:35.159268 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-dd3da551-3666-4934-b2c5-54d7b63b3819 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031885 Jun 23 13:32:35.160032 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 14/26] 10.222.0.26 () {64 vars in 1332 bytes} [Thu Jun 23 13:32:35 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:32:37.504694 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-c69ed97b-bfff-4c3f-97ce-e4f08dfb8772 admin admin] Calling method '>' {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:32:37.505710 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-c69ed97b-bfff-4c3f-97ce-e4f08dfb8772 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jun 23 13:32:37.506116 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 930 bytes} [Thu Jun 23 13:32:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:32:37.568641 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-7c7ea665-7c5d-4fab-a020-52e179f64d04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "m1.medium", "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "3"}} {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:32:37.593631 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-7c7ea665-7c5d-4fab-a020-52e179f64d04 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.081471 Jun 23 13:32:37.594504 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 15/28] 10.222.0.26 () {64 vars in 1282 bytes} [Thu Jun 23 13:32:37 2022] POST /compute/v2.1/flavors => generated 406 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 13:32:37.607013 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-64e1b3da-42e0-4124-9921-06230b85fa0d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:32:37.635283 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-64e1b3da-42e0-4124-9921-06230b85fa0d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032054 Jun 23 13:32:37.636146 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 14/29] 10.222.0.26 () {64 vars in 1332 bytes} [Thu Jun 23 13:32:37 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:32:39.707516 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-7c7ea665-7c5d-4fab-a020-52e179f64d04 admin admin] Calling method '>' {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:32:39.708542 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-7c7ea665-7c5d-4fab-a020-52e179f64d04 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Jun 23 13:32:39.708940 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 930 bytes} [Thu Jun 23 13:32:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:32:39.770153 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-ab4e1616-bac0-4fa7-98f7-454595d4c865 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 4, "name": "m1.large", "id": "4", "ram": 8192, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0}} {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:32:39.789096 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-ab4e1616-bac0-4fa7-98f7-454595d4c865 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073885 Jun 23 13:32:39.789869 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 15/31] 10.222.0.26 () {64 vars in 1282 bytes} [Thu Jun 23 13:32:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 13:32:39.801869 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-34b64dd0-e2c5-46ba-a5a5-d941c3686c3e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:32:39.825571 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-34b64dd0-e2c5-46ba-a5a5-d941c3686c3e admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027465 Jun 23 13:32:39.826177 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 17/32] 10.222.0.26 () {64 vars in 1332 bytes} [Thu Jun 23 13:32:39 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:32:41.871223 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-ab4e1616-bac0-4fa7-98f7-454595d4c865 admin admin] Calling method '>' {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:32:41.872282 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-ab4e1616-bac0-4fa7-98f7-454595d4c865 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Jun 23 13:32:41.872860 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 16/33] 10.222.0.26 () {54 vars in 930 bytes} [Thu Jun 23 13:32:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:32:41.932036 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-4a1418c2-9f7a-41e1-82db-e47c12d0771a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "vcpus": 8, "ram": 16384, "disk": 160, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge"}} {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:32:41.952297 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-4a1418c2-9f7a-41e1-82db-e47c12d0771a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.073334 Jun 23 13:32:41.953014 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 18/34] 10.222.0.26 () {64 vars in 1282 bytes} [Thu Jun 23 13:32:41 2022] POST /compute/v2.1/flavors => generated 408 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 13:32:41.965900 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-f4492f5e-64b5-46d6-9c23-32fffc2a2c73 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:32:41.992093 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-f4492f5e-64b5-46d6-9c23-32fffc2a2c73 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030061 Jun 23 13:32:41.992995 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1332 bytes} [Thu Jun 23 13:32:41 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:33:07.323979 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-4a1418c2-9f7a-41e1-82db-e47c12d0771a admin admin] Calling method '>' {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:33:07.325311 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-4a1418c2-9f7a-41e1-82db-e47c12d0771a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002060 Jun 23 13:33:07.325872 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 930 bytes} [Thu Jun 23 13:33:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:33:07.340090 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG dbcounter [-] [109800] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=109800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:07.399499 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-42551d34-3752-43d0-b768-067d85eef978 admin admin] Calling method '>' {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:33:07.417712 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-42551d34-3752-43d0-b768-067d85eef978 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.082938 Jun 23 13:33:07.418286 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1291 bytes} [Thu Jun 23 13:33:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:33:08.358457 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-4a1418c2-9f7a-41e1-82db-e47c12d0771a admin admin] Calling method '>' {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:33:08.360174 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-4a1418c2-9f7a-41e1-82db-e47c12d0771a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002159 Jun 23 13:33:08.360613 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Jun 23 13:33:08 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:33:08.552195 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-280c68c6-8ad9-4b76-83ab-07f30b43c73a admin admin] Calling method '>' {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:33:08.558286 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.wsgi [None req-280c68c6-8ad9-4b76-83ab-07f30b43c73a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 23 13:33:08.561596 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-280c68c6-8ad9-4b76-83ab-07f30b43c73a admin admin] Request method failure captured: Jun 23 13:33:08.561596 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 23 13:33:08.561596 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: Accept: application/json Jun 23 13:33:08.561596 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: Accept-Encoding: gzip, deflate Jun 23 13:33:08.561596 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: Connection: keep-alive Jun 23 13:33:08.561596 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: Content-Length: 0 Jun 23 13:33:08.561596 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: Host: 10.222.0.26 Jun 23 13:33:08.561596 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: Openstack-Api-Version: compute 2.90 Jun 23 13:33:08.561596 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: Openstack-System-Scope: None Jun 23 13:33:08.561596 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: User-Agent: python-novaclient Jun 23 13:33:08.561596 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Auth-Token: gAAAAABitGuUdV-eCPAMAg_yC7gyue6OFuZ3fuMzUhlCVsV8zjkgTMv63yBva48kVpmP24guFJTkASbEs4VPoclsvY73L9lHZNcwHPf34CX3X8RL62HzkeHJUyRlp5NUenZuQ1B88g7ZqsmRgEsjl_JVaU0JEEm1yPTKaTHy6Xd2T1NFHAVdOJ4 Jun 23 13:33:08.561596 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Domain-Id: None Jun 23 13:33:08.561596 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Domain-Name: None Jun 23 13:33:08.561596 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Identity-Status: Confirmed Jun 23 13:33:08.561596 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Is-Admin-Project: True Jun 23 13:33:08.561596 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 13:33:08.561596 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Project-Domain-Id: default Jun 23 13:33:08.561596 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Project-Domain-Name: Default Jun 23 13:33:08.561596 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Project-Id: ee8652e385f24bd9be7726e25f653946 Jun 23 13:33:08.561596 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Project-Name: admin Jun 23 13:33:08.561596 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Role: member,admin,reader Jun 23 13:33:08.561596 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Roles: member,admin,reader Jun 23 13:33:08.563059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ee8652e385f24bd9be7726e25f653946"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee8652e385f24bd9be7726e25f653946"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee8652e385f24bd9be7726e25f653946"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ee8652e385f24bd9be7726e25f653946", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:33:08.563059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Tenant: admin Jun 23 13:33:08.563059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Tenant-Id: ee8652e385f24bd9be7726e25f653946 Jun 23 13:33:08.563059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Tenant-Name: admin Jun 23 13:33:08.563059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-User: admin Jun 23 13:33:08.563059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-User-Domain-Id: default Jun 23 13:33:08.563059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-User-Domain-Name: Default Jun 23 13:33:08.563059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-User-Id: 2dee5b081bb1404bb27ed23c7dae2bf0 Jun 23 13:33:08.563059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-User-Name: admin Jun 23 13:33:08.563059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: method: > Jun 23 13:33:08.563059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: exception: Flavor 42 could not be found. Jun 23 13:33:08.563059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: action_args: {'id': '42'} Jun 23 13:33:08.563059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:33:08.563059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:33:08.563975 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 13:33:08.563975 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 13:33:08.563975 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 13:33:08.563975 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 13:33:08.563975 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 13:33:08.563975 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 13:33:08.563975 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 13:33:08.563975 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 13:33:08.563975 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 13:33:08.563975 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:33:08.563975 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 13:33:08.563975 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 13:33:08.563975 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 23 13:33:08.563975 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi Jun 23 13:33:08.563975 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:33:08.563975 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi Jun 23 13:33:08.563975 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:33:08.563975 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:33:08.563975 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:33:08.565114 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:33:08.565114 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:33:08.565114 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:33:08.565114 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:33:08.565114 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 13:33:08.565114 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:33:08.565114 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 23 13:33:08.565114 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi Jun 23 13:33:08.565114 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:33:08.565114 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi Jun 23 13:33:08.565114 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:33:08.565114 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:33:08.565114 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:33:08.565114 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:33:08.565114 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:33:08.565114 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 23 13:33:08.565114 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi Jun 23 13:33:08.565114 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-280c68c6-8ad9-4b76-83ab-07f30b43c73a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:33:08.566214 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-280c68c6-8ad9-4b76-83ab-07f30b43c73a admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.066703 Jun 23 13:33:08.566214 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1190 bytes} [Thu Jun 23 13:33:08 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 13:33:08.575548 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-6e298665-1ded-4ad6-8285-5834d48b75e1 admin admin] Calling method '>' {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:33:08.578603 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG dbcounter [-] [109799] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:33:08.599708 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-6e298665-1ded-4ad6-8285-5834d48b75e1 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029742 Jun 23 13:33:08.600270 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1210 bytes} [Thu Jun 23 13:33:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:33:08.612867 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-ec821b43-6236-48f8-b61c-92f86aab5112 admin admin] Calling method '>' {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:33:08.641822 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-ec821b43-6236-48f8-b61c-92f86aab5112 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.034677 Jun 23 13:33:08.642373 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1210 bytes} [Thu Jun 23 13:33:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:33:08.653828 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-daf7367c-14be-4897-9cdf-f6767f40265c admin admin] Calling method '>' {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:33:08.660736 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.wsgi [None req-daf7367c-14be-4897-9cdf-f6767f40265c admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 23 13:33:08.666175 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-daf7367c-14be-4897-9cdf-f6767f40265c admin admin] Request method failure captured: Jun 23 13:33:08.666175 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 23 13:33:08.666175 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: Accept: application/json Jun 23 13:33:08.666175 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: Accept-Encoding: gzip, deflate Jun 23 13:33:08.666175 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: Connection: keep-alive Jun 23 13:33:08.666175 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: Content-Length: 0 Jun 23 13:33:08.666175 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: Host: 10.222.0.26 Jun 23 13:33:08.666175 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: Openstack-Api-Version: compute 2.90 Jun 23 13:33:08.666175 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: Openstack-System-Scope: None Jun 23 13:33:08.666175 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: User-Agent: python-novaclient Jun 23 13:33:08.666175 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Auth-Token: gAAAAABitGuUdV-eCPAMAg_yC7gyue6OFuZ3fuMzUhlCVsV8zjkgTMv63yBva48kVpmP24guFJTkASbEs4VPoclsvY73L9lHZNcwHPf34CX3X8RL62HzkeHJUyRlp5NUenZuQ1B88g7ZqsmRgEsjl_JVaU0JEEm1yPTKaTHy6Xd2T1NFHAVdOJ4 Jun 23 13:33:08.666175 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Domain-Id: None Jun 23 13:33:08.666175 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Domain-Name: None Jun 23 13:33:08.666175 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Identity-Status: Confirmed Jun 23 13:33:08.666175 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Is-Admin-Project: True Jun 23 13:33:08.666175 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 13:33:08.666175 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Project-Domain-Id: default Jun 23 13:33:08.666175 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Project-Domain-Name: Default Jun 23 13:33:08.666175 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Project-Id: ee8652e385f24bd9be7726e25f653946 Jun 23 13:33:08.666175 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Project-Name: admin Jun 23 13:33:08.666175 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Role: member,admin,reader Jun 23 13:33:08.666175 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Roles: member,admin,reader Jun 23 13:33:08.668698 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ee8652e385f24bd9be7726e25f653946"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee8652e385f24bd9be7726e25f653946"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee8652e385f24bd9be7726e25f653946"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ee8652e385f24bd9be7726e25f653946", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:33:08.668698 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Tenant: admin Jun 23 13:33:08.668698 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Tenant-Id: ee8652e385f24bd9be7726e25f653946 Jun 23 13:33:08.668698 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Tenant-Name: admin Jun 23 13:33:08.668698 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-User: admin Jun 23 13:33:08.668698 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-User-Domain-Id: default Jun 23 13:33:08.668698 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-User-Domain-Name: Default Jun 23 13:33:08.668698 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-User-Id: 2dee5b081bb1404bb27ed23c7dae2bf0 Jun 23 13:33:08.668698 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-User-Name: admin Jun 23 13:33:08.668698 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: method: > Jun 23 13:33:08.668698 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: exception: Flavor 42 could not be found. Jun 23 13:33:08.668698 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: action_args: {'id': '42'} Jun 23 13:33:08.668698 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:33:08.668698 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:33:08.669863 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 13:33:08.669863 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 13:33:08.669863 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 13:33:08.669863 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 13:33:08.669863 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 13:33:08.669863 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 13:33:08.669863 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 13:33:08.669863 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 13:33:08.669863 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 13:33:08.669863 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:33:08.669863 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 13:33:08.669863 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 13:33:08.669863 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 23 13:33:08.669863 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi Jun 23 13:33:08.669863 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:33:08.669863 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi Jun 23 13:33:08.669863 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:33:08.669863 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:33:08.669863 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:33:08.671199 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:33:08.671199 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:33:08.671199 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:33:08.671199 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:33:08.671199 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 13:33:08.671199 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:33:08.671199 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 23 13:33:08.671199 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi Jun 23 13:33:08.671199 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:33:08.671199 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi Jun 23 13:33:08.671199 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:33:08.671199 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:33:08.671199 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:33:08.671199 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:33:08.671199 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:33:08.671199 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 23 13:33:08.671199 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi Jun 23 13:33:08.671199 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-daf7367c-14be-4897-9cdf-f6767f40265c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:33:08.672471 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-daf7367c-14be-4897-9cdf-f6767f40265c admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.019310 Jun 23 13:33:08.672471 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1190 bytes} [Thu Jun 23 13:33:08 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 13:33:09.517047 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-ec821b43-6236-48f8-b61c-92f86aab5112 admin admin] Calling method '>' {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:33:09.518064 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-ec821b43-6236-48f8-b61c-92f86aab5112 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jun 23 13:33:09.518458 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 21/43] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Jun 23 13:33:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:33:09.720236 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-524d5b41-e8dc-4c7c-b84a-3192947c6745 admin admin] Calling method '>' {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:33:09.726170 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.wsgi [None req-524d5b41-e8dc-4c7c-b84a-3192947c6745 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 23 13:33:09.727713 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-524d5b41-e8dc-4c7c-b84a-3192947c6745 admin admin] Request method failure captured: Jun 23 13:33:09.727713 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 23 13:33:09.727713 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: Accept: application/json Jun 23 13:33:09.727713 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: Accept-Encoding: gzip, deflate Jun 23 13:33:09.727713 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: Connection: keep-alive Jun 23 13:33:09.727713 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: Content-Length: 0 Jun 23 13:33:09.727713 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: Host: 10.222.0.26 Jun 23 13:33:09.727713 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: Openstack-Api-Version: compute 2.90 Jun 23 13:33:09.727713 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: Openstack-System-Scope: None Jun 23 13:33:09.727713 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: User-Agent: python-novaclient Jun 23 13:33:09.727713 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Auth-Token: gAAAAABitGuVmHiaVh2RsR2fAbeIFz96t_DlRvXbcZZamwPYXq2zyNfWQg_p3M3Kh1SgAtcLEymB_q-ZGgc3e4gqeWJr3nC58Nkmk_m60am3PmIS96r9g6ekSU8-QaWjlmlbOEOdXvFbe0_wIoSOXAXNOUdPC5bT6sDqbiLO84hkUVc0K2Td-AM Jun 23 13:33:09.727713 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Domain-Id: None Jun 23 13:33:09.727713 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Domain-Name: None Jun 23 13:33:09.727713 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Identity-Status: Confirmed Jun 23 13:33:09.727713 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Is-Admin-Project: True Jun 23 13:33:09.727713 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 13:33:09.727713 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Project-Domain-Id: default Jun 23 13:33:09.727713 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Project-Domain-Name: Default Jun 23 13:33:09.727713 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Project-Id: ee8652e385f24bd9be7726e25f653946 Jun 23 13:33:09.727713 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Project-Name: admin Jun 23 13:33:09.727713 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Role: member,admin,reader Jun 23 13:33:09.727713 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Roles: member,admin,reader Jun 23 13:33:09.729339 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ee8652e385f24bd9be7726e25f653946"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee8652e385f24bd9be7726e25f653946"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee8652e385f24bd9be7726e25f653946"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ee8652e385f24bd9be7726e25f653946", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:33:09.729339 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Tenant: admin Jun 23 13:33:09.729339 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Tenant-Id: ee8652e385f24bd9be7726e25f653946 Jun 23 13:33:09.729339 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Tenant-Name: admin Jun 23 13:33:09.729339 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-User: admin Jun 23 13:33:09.729339 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-User-Domain-Id: default Jun 23 13:33:09.729339 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-User-Domain-Name: Default Jun 23 13:33:09.729339 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-User-Id: 2dee5b081bb1404bb27ed23c7dae2bf0 Jun 23 13:33:09.729339 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-User-Name: admin Jun 23 13:33:09.729339 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: method: > Jun 23 13:33:09.729339 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: exception: Flavor 84 could not be found. Jun 23 13:33:09.729339 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: action_args: {'id': '84'} Jun 23 13:33:09.729339 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:33:09.729339 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:33:09.730326 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 13:33:09.730326 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 13:33:09.730326 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 13:33:09.730326 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 13:33:09.730326 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 13:33:09.730326 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 13:33:09.730326 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 13:33:09.730326 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 13:33:09.730326 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 13:33:09.730326 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:33:09.730326 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 13:33:09.730326 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 13:33:09.730326 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 23 13:33:09.730326 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi Jun 23 13:33:09.730326 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:33:09.730326 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi Jun 23 13:33:09.730326 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:33:09.730326 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:33:09.730326 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:33:09.731455 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:33:09.731455 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:33:09.731455 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:33:09.731455 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:33:09.731455 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 13:33:09.731455 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:33:09.731455 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 23 13:33:09.731455 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi Jun 23 13:33:09.731455 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:33:09.731455 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi Jun 23 13:33:09.731455 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:33:09.731455 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:33:09.731455 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:33:09.731455 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:33:09.731455 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:33:09.731455 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 23 13:33:09.731455 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi Jun 23 13:33:09.731455 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-524d5b41-e8dc-4c7c-b84a-3192947c6745 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:33:09.732522 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-524d5b41-e8dc-4c7c-b84a-3192947c6745 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.072618 Jun 23 13:33:09.732522 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1190 bytes} [Thu Jun 23 13:33:09 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 13:33:09.739102 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-ca32c1b0-7a8a-4623-ac79-07f3b6aeddfa admin admin] Calling method '>' {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:33:09.752945 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-ca32c1b0-7a8a-4623-ac79-07f3b6aeddfa admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017411 Jun 23 13:33:09.753509 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1210 bytes} [Thu Jun 23 13:33:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:33:09.763085 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-6cab419b-9308-4944-b934-6ee350697563 admin admin] Calling method '>' {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:33:09.778875 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-6cab419b-9308-4944-b934-6ee350697563 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019464 Jun 23 13:33:09.779386 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1210 bytes} [Thu Jun 23 13:33:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:33:09.788645 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-6b1676a4-336d-4492-be1b-7a929387b894 admin admin] Calling method '>' {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:33:09.794125 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.wsgi [None req-6b1676a4-336d-4492-be1b-7a929387b894 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 23 13:33:09.795670 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-6b1676a4-336d-4492-be1b-7a929387b894 admin admin] Request method failure captured: Jun 23 13:33:09.795670 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 23 13:33:09.795670 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: Accept: application/json Jun 23 13:33:09.795670 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: Accept-Encoding: gzip, deflate Jun 23 13:33:09.795670 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: Connection: keep-alive Jun 23 13:33:09.795670 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: Content-Length: 0 Jun 23 13:33:09.795670 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: Host: 10.222.0.26 Jun 23 13:33:09.795670 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: Openstack-Api-Version: compute 2.90 Jun 23 13:33:09.795670 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: Openstack-System-Scope: None Jun 23 13:33:09.795670 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: User-Agent: python-novaclient Jun 23 13:33:09.795670 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Auth-Token: gAAAAABitGuVmHiaVh2RsR2fAbeIFz96t_DlRvXbcZZamwPYXq2zyNfWQg_p3M3Kh1SgAtcLEymB_q-ZGgc3e4gqeWJr3nC58Nkmk_m60am3PmIS96r9g6ekSU8-QaWjlmlbOEOdXvFbe0_wIoSOXAXNOUdPC5bT6sDqbiLO84hkUVc0K2Td-AM Jun 23 13:33:09.795670 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Domain-Id: None Jun 23 13:33:09.795670 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Domain-Name: None Jun 23 13:33:09.795670 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Identity-Status: Confirmed Jun 23 13:33:09.795670 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Is-Admin-Project: True Jun 23 13:33:09.795670 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 13:33:09.795670 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Project-Domain-Id: default Jun 23 13:33:09.795670 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Project-Domain-Name: Default Jun 23 13:33:09.795670 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Project-Id: ee8652e385f24bd9be7726e25f653946 Jun 23 13:33:09.795670 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Project-Name: admin Jun 23 13:33:09.795670 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Role: member,admin,reader Jun 23 13:33:09.795670 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Roles: member,admin,reader Jun 23 13:33:09.797059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ee8652e385f24bd9be7726e25f653946"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee8652e385f24bd9be7726e25f653946"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee8652e385f24bd9be7726e25f653946"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ee8652e385f24bd9be7726e25f653946", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:33:09.797059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Tenant: admin Jun 23 13:33:09.797059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Tenant-Id: ee8652e385f24bd9be7726e25f653946 Jun 23 13:33:09.797059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Tenant-Name: admin Jun 23 13:33:09.797059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-User: admin Jun 23 13:33:09.797059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-User-Domain-Id: default Jun 23 13:33:09.797059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-User-Domain-Name: Default Jun 23 13:33:09.797059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-User-Id: 2dee5b081bb1404bb27ed23c7dae2bf0 Jun 23 13:33:09.797059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-User-Name: admin Jun 23 13:33:09.797059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: method: > Jun 23 13:33:09.797059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: exception: Flavor 84 could not be found. Jun 23 13:33:09.797059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: action_args: {'id': '84'} Jun 23 13:33:09.797059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:33:09.797059 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:33:09.797838 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 13:33:09.797838 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 13:33:09.797838 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 13:33:09.797838 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 13:33:09.797838 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 13:33:09.797838 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 13:33:09.797838 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 13:33:09.797838 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 13:33:09.797838 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 13:33:09.797838 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:33:09.797838 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 13:33:09.797838 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 13:33:09.797838 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 23 13:33:09.797838 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi Jun 23 13:33:09.797838 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:33:09.797838 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi Jun 23 13:33:09.797838 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:33:09.797838 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:33:09.797838 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:33:09.798931 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:33:09.798931 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:33:09.798931 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:33:09.798931 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:33:09.798931 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 13:33:09.798931 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:33:09.798931 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 23 13:33:09.798931 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi Jun 23 13:33:09.798931 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:33:09.798931 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi Jun 23 13:33:09.798931 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:33:09.798931 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:33:09.798931 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:33:09.798931 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:33:09.798931 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:33:09.798931 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 23 13:33:09.798931 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi Jun 23 13:33:09.798931 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-6b1676a4-336d-4492-be1b-7a929387b894 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:33:09.800008 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-6b1676a4-336d-4492-be1b-7a929387b894 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011955 Jun 23 13:33:09.800008 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 23/47] 10.222.0.26 () {60 vars in 1190 bytes} [Thu Jun 23 13:33:09 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 23 13:33:10.630833 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-6cab419b-9308-4944-b934-6ee350697563 admin admin] Calling method '>' {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:33:10.632305 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-6cab419b-9308-4944-b934-6ee350697563 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002185 Jun 23 13:33:10.632901 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 25/48] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Jun 23 13:33:10 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:33:10.831370 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-7dccc657-3420-4a6b-b884-4c7f2bed71c5 admin admin] Calling method '>' {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:33:10.837738 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.wsgi [None req-7dccc657-3420-4a6b-b884-4c7f2bed71c5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 23 13:33:10.839291 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-7dccc657-3420-4a6b-b884-4c7f2bed71c5 admin admin] Request method failure captured: Jun 23 13:33:10.839291 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 23 13:33:10.839291 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: Accept: application/json Jun 23 13:33:10.839291 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: Accept-Encoding: gzip, deflate Jun 23 13:33:10.839291 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: Connection: keep-alive Jun 23 13:33:10.839291 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: Content-Length: 0 Jun 23 13:33:10.839291 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: Host: 10.222.0.26 Jun 23 13:33:10.839291 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: Openstack-Api-Version: compute 2.90 Jun 23 13:33:10.839291 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: Openstack-System-Scope: None Jun 23 13:33:10.839291 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: User-Agent: python-novaclient Jun 23 13:33:10.839291 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Auth-Token: gAAAAABitGuWXx5aqrHYx0pOvg9RejmJvWx3BxXoOWy-4RCdxCgaMwj1idiMW3aQlKAnCntAcwRIXj63fENM4fYalpVskASAw7mu2xRgmu196PI6eXKO41YQcxssLby5CI--1fD51B7Vfh-EFpextHQLZ2GtnX31fXvE9Zp1l8NAUPl4sxcPqp0 Jun 23 13:33:10.839291 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Domain-Id: None Jun 23 13:33:10.839291 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Domain-Name: None Jun 23 13:33:10.839291 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Identity-Status: Confirmed Jun 23 13:33:10.839291 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Is-Admin-Project: True Jun 23 13:33:10.839291 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 13:33:10.839291 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Project-Domain-Id: default Jun 23 13:33:10.839291 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Project-Domain-Name: Default Jun 23 13:33:10.839291 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Project-Id: ee8652e385f24bd9be7726e25f653946 Jun 23 13:33:10.839291 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Project-Name: admin Jun 23 13:33:10.839291 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Role: member,admin,reader Jun 23 13:33:10.839291 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Roles: member,admin,reader Jun 23 13:33:10.840794 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ee8652e385f24bd9be7726e25f653946"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee8652e385f24bd9be7726e25f653946"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee8652e385f24bd9be7726e25f653946"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ee8652e385f24bd9be7726e25f653946", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:33:10.840794 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Tenant: admin Jun 23 13:33:10.840794 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Tenant-Id: ee8652e385f24bd9be7726e25f653946 Jun 23 13:33:10.840794 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-Tenant-Name: admin Jun 23 13:33:10.840794 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-User: admin Jun 23 13:33:10.840794 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-User-Domain-Id: default Jun 23 13:33:10.840794 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-User-Domain-Name: Default Jun 23 13:33:10.840794 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-User-Id: 2dee5b081bb1404bb27ed23c7dae2bf0 Jun 23 13:33:10.840794 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: X-User-Name: admin Jun 23 13:33:10.840794 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: method: > Jun 23 13:33:10.840794 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: exception: Flavor 451 could not be found. Jun 23 13:33:10.840794 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: action_args: {'id': '451'} Jun 23 13:33:10.840794 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:33:10.840794 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:33:10.841698 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 13:33:10.841698 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 13:33:10.841698 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 13:33:10.841698 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 13:33:10.841698 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 13:33:10.841698 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 13:33:10.841698 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 13:33:10.841698 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 13:33:10.841698 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 13:33:10.841698 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:33:10.841698 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 13:33:10.841698 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 13:33:10.841698 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 23 13:33:10.841698 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi Jun 23 13:33:10.841698 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:33:10.841698 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi Jun 23 13:33:10.841698 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:33:10.841698 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:33:10.841698 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:33:10.842928 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:33:10.842928 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:33:10.842928 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:33:10.842928 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:33:10.842928 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 13:33:10.842928 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:33:10.842928 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 23 13:33:10.842928 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi Jun 23 13:33:10.842928 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:33:10.842928 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi Jun 23 13:33:10.842928 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:33:10.842928 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:33:10.842928 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:33:10.842928 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:33:10.842928 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:33:10.842928 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 23 13:33:10.842928 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: ERROR nova.api.openstack.wsgi Jun 23 13:33:10.842928 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-7dccc657-3420-4a6b-b884-4c7f2bed71c5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:33:10.844156 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-7dccc657-3420-4a6b-b884-4c7f2bed71c5 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.071182 Jun 23 13:33:10.844156 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 24/49] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Jun 23 13:33:10 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 13:33:10.850643 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-8d4283fe-3a82-45f5-b9cc-27539883baab admin admin] Calling method '>' {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:33:10.864613 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-8d4283fe-3a82-45f5-b9cc-27539883baab admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017664 Jun 23 13:33:10.865361 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1210 bytes} [Thu Jun 23 13:33:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:33:10.874694 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-436fbb67-6245-4ae0-ab91-c77badb8803d admin admin] Calling method '>' {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:33:10.888474 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-436fbb67-6245-4ae0-ab91-c77badb8803d admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017354 Jun 23 13:33:10.889020 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1210 bytes} [Thu Jun 23 13:33:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:33:10.898719 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-409655df-191a-490e-8fae-f28303874472 admin admin] Calling method '>' {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:33:10.904626 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.wsgi [None req-409655df-191a-490e-8fae-f28303874472 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 23 13:33:10.906116 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-409655df-191a-490e-8fae-f28303874472 admin admin] Request method failure captured: Jun 23 13:33:10.906116 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 23 13:33:10.906116 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: Accept: application/json Jun 23 13:33:10.906116 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: Accept-Encoding: gzip, deflate Jun 23 13:33:10.906116 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: Connection: keep-alive Jun 23 13:33:10.906116 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: Content-Length: 0 Jun 23 13:33:10.906116 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: Host: 10.222.0.26 Jun 23 13:33:10.906116 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: Openstack-Api-Version: compute 2.90 Jun 23 13:33:10.906116 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: Openstack-System-Scope: None Jun 23 13:33:10.906116 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: User-Agent: python-novaclient Jun 23 13:33:10.906116 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Auth-Token: gAAAAABitGuWXx5aqrHYx0pOvg9RejmJvWx3BxXoOWy-4RCdxCgaMwj1idiMW3aQlKAnCntAcwRIXj63fENM4fYalpVskASAw7mu2xRgmu196PI6eXKO41YQcxssLby5CI--1fD51B7Vfh-EFpextHQLZ2GtnX31fXvE9Zp1l8NAUPl4sxcPqp0 Jun 23 13:33:10.906116 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Domain-Id: None Jun 23 13:33:10.906116 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Domain-Name: None Jun 23 13:33:10.906116 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Identity-Status: Confirmed Jun 23 13:33:10.906116 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Is-Admin-Project: True Jun 23 13:33:10.906116 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 13:33:10.906116 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Project-Domain-Id: default Jun 23 13:33:10.906116 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Project-Domain-Name: Default Jun 23 13:33:10.906116 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Project-Id: ee8652e385f24bd9be7726e25f653946 Jun 23 13:33:10.906116 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Project-Name: admin Jun 23 13:33:10.906116 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Role: member,admin,reader Jun 23 13:33:10.906116 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Roles: member,admin,reader Jun 23 13:33:10.907814 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ee8652e385f24bd9be7726e25f653946"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee8652e385f24bd9be7726e25f653946"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee8652e385f24bd9be7726e25f653946"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ee8652e385f24bd9be7726e25f653946", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:33:10.907814 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Tenant: admin Jun 23 13:33:10.907814 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Tenant-Id: ee8652e385f24bd9be7726e25f653946 Jun 23 13:33:10.907814 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-Tenant-Name: admin Jun 23 13:33:10.907814 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-User: admin Jun 23 13:33:10.907814 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-User-Domain-Id: default Jun 23 13:33:10.907814 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-User-Domain-Name: Default Jun 23 13:33:10.907814 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-User-Id: 2dee5b081bb1404bb27ed23c7dae2bf0 Jun 23 13:33:10.907814 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: X-User-Name: admin Jun 23 13:33:10.907814 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: method: > Jun 23 13:33:10.907814 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: exception: Flavor 451 could not be found. Jun 23 13:33:10.907814 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: action_args: {'id': '451'} Jun 23 13:33:10.907814 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:33:10.907814 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:33:10.908776 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 13:33:10.908776 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 13:33:10.908776 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 13:33:10.908776 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 13:33:10.908776 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 13:33:10.908776 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 13:33:10.908776 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 13:33:10.908776 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 13:33:10.908776 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 13:33:10.908776 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:33:10.908776 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 13:33:10.908776 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 13:33:10.908776 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 23 13:33:10.908776 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi Jun 23 13:33:10.908776 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:33:10.908776 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi Jun 23 13:33:10.908776 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:33:10.908776 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:33:10.908776 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:33:10.910030 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:33:10.910030 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:33:10.910030 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:33:10.910030 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:33:10.910030 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 13:33:10.910030 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:33:10.910030 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 23 13:33:10.910030 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi Jun 23 13:33:10.910030 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:33:10.910030 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi Jun 23 13:33:10.910030 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:33:10.910030 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:33:10.910030 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:33:10.910030 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:33:10.910030 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:33:10.910030 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 23 13:33:10.910030 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: ERROR nova.api.openstack.wsgi Jun 23 13:33:10.910030 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-409655df-191a-490e-8fae-f28303874472 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109799) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:33:10.911275 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-409655df-191a-490e-8fae-f28303874472 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012629 Jun 23 13:33:10.911275 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 27/52] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Jun 23 13:33:10 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 13:33:11.715491 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-436fbb67-6245-4ae0-ab91-c77badb8803d admin admin] Calling method '>' {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:33:11.716644 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-436fbb67-6245-4ae0-ab91-c77badb8803d admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001614 Jun 23 13:33:11.717050 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Jun 23 13:33:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:33:11.915846 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-9c4ec06f-c170-4e7c-aec3-f2df0bfda7a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:33:11.938518 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-9c4ec06f-c170-4e7c-aec3-f2df0bfda7a6 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.085879 Jun 23 13:33:11.938986 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1235 bytes} [Thu Jun 23 13:33:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 13:33:12.763673 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-436fbb67-6245-4ae0-ab91-c77badb8803d admin admin] Calling method '>' {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:33:12.764683 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-436fbb67-6245-4ae0-ab91-c77badb8803d admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jun 23 13:33:12.765074 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Jun 23 13:33:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:33:12.956411 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-28f1777e-8ee1-433f-8b7d-bfc92c06995c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:33:12.981540 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-28f1777e-8ee1-433f-8b7d-bfc92c06995c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.080037 Jun 23 13:33:12.982016 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 29/56] 10.222.0.26 () {64 vars in 1235 bytes} [Thu Jun 23 13:33:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 13:33:13.802591 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-436fbb67-6245-4ae0-ab91-c77badb8803d admin admin] Calling method '>' {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:33:13.803994 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-436fbb67-6245-4ae0-ab91-c77badb8803d admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003644 Jun 23 13:33:13.804475 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Jun 23 13:33:13 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:33:14.006736 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-7d0754e3-50a4-44af-9d53-f14d6492d481 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:33:14.027800 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-7d0754e3-50a4-44af-9d53-f14d6492d481 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.082698 Jun 23 13:33:14.028324 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 30/58] 10.222.0.26 () {64 vars in 1235 bytes} [Thu Jun 23 13:33:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 13:33:14.855828 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-436fbb67-6245-4ae0-ab91-c77badb8803d admin admin] Calling method '>' {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:33:14.856872 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-436fbb67-6245-4ae0-ab91-c77badb8803d admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jun 23 13:33:14.857271 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 29/59] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Jun 23 13:33:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:33:15.060367 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-1152eb2d-65c8-4544-a905-b0ab8072bc94 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:33:15.080316 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-1152eb2d-65c8-4544-a905-b0ab8072bc94 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.082951 Jun 23 13:33:15.080850 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 31/60] 10.222.0.26 () {64 vars in 1235 bytes} [Thu Jun 23 13:33:14 2022] POST /compute/v2.1/flavors => generated 409 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 13:33:15.909612 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-436fbb67-6245-4ae0-ab91-c77badb8803d admin admin] Calling method '>' {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:33:15.910595 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-436fbb67-6245-4ae0-ab91-c77badb8803d admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jun 23 13:33:15.911003 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 30/61] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Jun 23 13:33:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:33:16.114124 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-ffd31f55-25ce-4005-938c-c77d8a88bfe8 admin admin] Calling method '>' {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:33:16.133576 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-ffd31f55-25ce-4005-938c-c77d8a88bfe8 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.082626 Jun 23 13:33:16.134143 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 32/62] 10.222.0.26 () {60 vars in 1202 bytes} [Thu Jun 23 13:33:16 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:34:02.509601 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-436fbb67-6245-4ae0-ab91-c77badb8803d admin admin] Calling method '>' {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:34:02.510677 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-436fbb67-6245-4ae0-ab91-c77badb8803d admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jun 23 13:34:02.511083 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 930 bytes} [Thu Jun 23 13:34:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:34:02.521478 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG dbcounter [-] [109799] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:02.572343 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-f6044ef2-ce03-4d79-8267-98b963486add admin admin] Calling method '>' {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:34:02.591986 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-f6044ef2-ce03-4d79-8267-98b963486add admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075067 Jun 23 13:34:02.592541 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 33/64] 10.222.0.26 () {60 vars in 1291 bytes} [Thu Jun 23 13:34:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:34:02.618386 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-3dbedc6f-c47c-43f5-a9df-aefb3ea4a2c4 admin admin] Calling method '>' {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:34:02.622621 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG dbcounter [-] [109800] Writing DB stats nova_api:SELECT=14 {{(pid=109800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:34:02.628154 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-3dbedc6f-c47c-43f5-a9df-aefb3ea4a2c4 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015938 Jun 23 13:34:02.628689 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1282 bytes} [Thu Jun 23 13:34:02 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:34:02.640316 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-bf86a9fd-7e75-4a01-96b7-518bab8c2aff admin admin] Calling method '>' {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:34:02.648064 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-bf86a9fd-7e75-4a01-96b7-518bab8c2aff admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011343 Jun 23 13:34:02.648580 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1285 bytes} [Thu Jun 23 13:34:02 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:34:02.660141 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-5eeb3c30-2454-4fe8-b726-b3305a2323d6 admin admin] Calling method '>' {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:34:02.668066 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-5eeb3c30-2454-4fe8-b726-b3305a2323d6 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011696 Jun 23 13:34:02.668622 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1285 bytes} [Thu Jun 23 13:34:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:34:02.682569 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-daea0343-99f4-46b1-bc9f-b5996d8d7494 admin admin] Calling method '>' {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:34:02.690406 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-daea0343-99f4-46b1-bc9f-b5996d8d7494 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013754 Jun 23 13:34:02.690991 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1282 bytes} [Thu Jun 23 13:34:02 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:37:16.873276 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-5eeb3c30-2454-4fe8-b726-b3305a2323d6 admin admin] Calling method '>' {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:37:16.874348 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-5eeb3c30-2454-4fe8-b726-b3305a2323d6 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Jun 23 13:37:16.874750 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 34/69] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Jun 23 13:37:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:37:17.015699 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG dbcounter [-] [109799] Writing DB stats nova_api:SELECT=6 {{(pid=109799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:17.139067 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-7d7046c5-2a99-42c3-9fe6-533f17e02d16 admin admin] Calling method '>' {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:37:17.140294 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:37:17.140294 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: warnings.warn(msg) Jun 23 13:37:17.141501 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG oslo_concurrency.lockutils [None req-7d7046c5-2a99-42c3-9fe6-533f17e02d16 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:37:17.141939 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG oslo_concurrency.lockutils [None req-7d7046c5-2a99-42c3-9fe6-533f17e02d16 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:37:17.142726 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG oslo_concurrency.lockutils [None req-7d7046c5-2a99-42c3-9fe6-533f17e02d16 admin admin] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:37:17.143149 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG oslo_concurrency.lockutils [None req-7d7046c5-2a99-42c3-9fe6-533f17e02d16 admin admin] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:37:17.176851 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-7d7046c5-2a99-42c3-9fe6-533f17e02d16 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.162702 Jun 23 13:37:17.177412 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 36/70] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Jun 23 13:37:17 2022] GET /compute/v2.1/os-services => generated 794 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 13:37:18.002643 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-5eeb3c30-2454-4fe8-b726-b3305a2323d6 admin admin] Calling method '>' {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:37:18.003687 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-5eeb3c30-2454-4fe8-b726-b3305a2323d6 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jun 23 13:37:18.004082 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 35/71] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Jun 23 13:37:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:37:18.206696 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-90b7eb7d-239f-4be8-a783-444d71b5cf1a admin admin] Calling method '>' {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:37:18.207892 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:37:18.207892 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: warnings.warn(msg) Jun 23 13:37:18.209076 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG oslo_concurrency.lockutils [None req-90b7eb7d-239f-4be8-a783-444d71b5cf1a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:37:18.209508 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG oslo_concurrency.lockutils [None req-90b7eb7d-239f-4be8-a783-444d71b5cf1a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:37:18.210281 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG oslo_concurrency.lockutils [None req-90b7eb7d-239f-4be8-a783-444d71b5cf1a admin admin] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:37:18.210701 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG oslo_concurrency.lockutils [None req-90b7eb7d-239f-4be8-a783-444d71b5cf1a admin admin] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:37:18.230177 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-90b7eb7d-239f-4be8-a783-444d71b5cf1a admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.085005 Jun 23 13:37:18.230716 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 37/72] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Jun 23 13:37:18 2022] GET /compute/v2.1/os-services => generated 794 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 13:37:29.496056 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-5eeb3c30-2454-4fe8-b726-b3305a2323d6 admin admin] Calling method '>' {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:37:29.497075 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-5eeb3c30-2454-4fe8-b726-b3305a2323d6 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 23 13:37:29.497521 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 36/73] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Jun 23 13:37:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:37:29.646286 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG dbcounter [-] [109799] Writing DB stats nova_cell0:SELECT=4 {{(pid=109799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:29.647390 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG dbcounter [-] [109799] Writing DB stats nova_cell1:SELECT=4 {{(pid=109799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:29.648324 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG dbcounter [-] [109799] Writing DB stats nova_api:SELECT=8 {{(pid=109799) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:37:29.705985 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-178cdb72-3203-4459-a302-c42abeba1dc5 admin admin] Calling method '>' {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:37:29.707154 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:37:29.707154 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: warnings.warn(msg) Jun 23 13:37:29.708399 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG oslo_concurrency.lockutils [None req-178cdb72-3203-4459-a302-c42abeba1dc5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:37:29.708838 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG oslo_concurrency.lockutils [None req-178cdb72-3203-4459-a302-c42abeba1dc5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:37:29.709623 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG oslo_concurrency.lockutils [None req-178cdb72-3203-4459-a302-c42abeba1dc5 admin admin] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:37:29.710076 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG oslo_concurrency.lockutils [None req-178cdb72-3203-4459-a302-c42abeba1dc5 admin admin] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:37:29.735232 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-178cdb72-3203-4459-a302-c42abeba1dc5 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.096336 Jun 23 13:37:29.735767 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 38/74] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Jun 23 13:37:29 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:37:30.542771 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: DEBUG nova.api.openstack.wsgi [None req-5eeb3c30-2454-4fe8-b726-b3305a2323d6 admin admin] Calling method '>' {{(pid=109800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:37:30.544187 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: INFO nova.api.openstack.requestlog [None req-5eeb3c30-2454-4fe8-b726-b3305a2323d6 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001995 Jun 23 13:37:30.544726 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: [pid: 109800|app: 0|req: 37/75] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Jun 23 13:37:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:37:30.738868 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG nova.api.openstack.wsgi [None req-00e3dec5-00cc-4cce-944c-9aad7c629155 admin admin] Calling method '>' {{(pid=109799) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:37:30.740061 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:37:30.740061 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: warnings.warn(msg) Jun 23 13:37:30.741280 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG oslo_concurrency.lockutils [None req-00e3dec5-00cc-4cce-944c-9aad7c629155 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:37:30.741722 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG oslo_concurrency.lockutils [None req-00e3dec5-00cc-4cce-944c-9aad7c629155 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:37:30.742514 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG oslo_concurrency.lockutils [None req-00e3dec5-00cc-4cce-944c-9aad7c629155 admin admin] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:37:30.742989 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: DEBUG oslo_concurrency.lockutils [None req-00e3dec5-00cc-4cce-944c-9aad7c629155 admin admin] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109799) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:37:30.765057 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: INFO nova.api.openstack.requestlog [None req-00e3dec5-00cc-4cce-944c-9aad7c629155 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.083780 Jun 23 13:37:30.765540 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: [pid: 109799|app: 0|req: 39/76] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Jun 23 13:37:30 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:38:26.021040 dv-cinder-815582-10-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 23 13:38:26.021965 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: Thu Jun 23 13:38:26 2022 - graceful shutdown triggered... Jun 23 13:38:26.022484 dv-cinder-815582-10-iscsi devstack@n-api.service[109799]: Gracefully killing worker 1 (pid: 109799)... Jun 23 13:38:26.022850 dv-cinder-815582-10-iscsi devstack@n-api.service[109800]: Gracefully killing worker 2 (pid: 109800)... Jun 23 13:38:27.022491 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: worker 1 buried after 1 seconds Jun 23 13:38:27.022491 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: worker 2 buried after 1 seconds Jun 23 13:38:27.022491 dv-cinder-815582-10-iscsi devstack@n-api.service[109798]: goodbye to uWSGI. Jun 23 13:38:27.025051 dv-cinder-815582-10-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 23 13:38:27.025947 dv-cinder-815582-10-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 23 13:38:27.030491 dv-cinder-815582-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 23 13:38:27.046504 dv-cinder-815582-10-iscsi devstack@n-api.service[134656]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 23 13:38:27.050150 dv-cinder-815582-10-iscsi devstack@n-api.service[134656]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 13:38:27 2022] *** Jun 23 13:38:27.050150 dv-cinder-815582-10-iscsi devstack@n-api.service[134656]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 13:38:27.050150 dv-cinder-815582-10-iscsi devstack@n-api.service[134656]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 13:38:27.050150 dv-cinder-815582-10-iscsi devstack@n-api.service[134656]: nodename: dv-cinder-815582-10-iscsi Jun 23 13:38:27.050150 dv-cinder-815582-10-iscsi devstack@n-api.service[134656]: machine: x86_64 Jun 23 13:38:27.050150 dv-cinder-815582-10-iscsi devstack@n-api.service[134656]: clock source: unix Jun 23 13:38:27.050150 dv-cinder-815582-10-iscsi devstack@n-api.service[134656]: pcre jit disabled Jun 23 13:38:27.050150 dv-cinder-815582-10-iscsi devstack@n-api.service[134656]: detected number of CPU cores: 4 Jun 23 13:38:27.050150 dv-cinder-815582-10-iscsi devstack@n-api.service[134656]: current working directory: / Jun 23 13:38:27.050150 dv-cinder-815582-10-iscsi devstack@n-api.service[134656]: detected binary path: /usr/bin/uwsgi-core Jun 23 13:38:27.052155 dv-cinder-815582-10-iscsi devstack@n-api.service[134656]: your processes number limit is 47680 Jun 23 13:38:27.052155 dv-cinder-815582-10-iscsi devstack@n-api.service[134656]: your memory page size is 4096 bytes Jun 23 13:38:27.052155 dv-cinder-815582-10-iscsi devstack@n-api.service[134656]: detected max file descriptor number: 2048 Jun 23 13:38:27.052155 dv-cinder-815582-10-iscsi devstack@n-api.service[134656]: lock engine: pthread robust mutexes Jun 23 13:38:27.052155 dv-cinder-815582-10-iscsi devstack@n-api.service[134656]: thunder lock: enabled Jun 23 13:38:27.052155 dv-cinder-815582-10-iscsi devstack@n-api.service[134656]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 23 13:38:27.052155 dv-cinder-815582-10-iscsi devstack@n-api.service[134656]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 13:38:27.098135 dv-cinder-815582-10-iscsi devstack@n-api.service[134656]: Python main interpreter initialized at 0x562e0202b9c0 Jun 23 13:38:27.098135 dv-cinder-815582-10-iscsi devstack@n-api.service[134656]: python threads support enabled Jun 23 13:38:27.098135 dv-cinder-815582-10-iscsi devstack@n-api.service[134656]: your server socket listen backlog is limited to 100 connections Jun 23 13:38:27.098135 dv-cinder-815582-10-iscsi devstack@n-api.service[134656]: your mercy for graceful operations on workers is 90 seconds Jun 23 13:38:27.098545 dv-cinder-815582-10-iscsi devstack@n-api.service[134656]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 13:38:27.098621 dv-cinder-815582-10-iscsi devstack@n-api.service[134656]: *** Operational MODE: preforking *** Jun 23 13:38:27.098892 dv-cinder-815582-10-iscsi devstack@n-api.service[134656]: *** uWSGI is running in multiple interpreter mode *** Jun 23 13:38:27.098892 dv-cinder-815582-10-iscsi devstack@n-api.service[134656]: spawned uWSGI master process (pid: 134656) Jun 23 13:38:27.099141 dv-cinder-815582-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 23 13:38:27.099734 dv-cinder-815582-10-iscsi devstack@n-api.service[134656]: spawned uWSGI worker 1 (pid: 134666, cores: 1) Jun 23 13:38:27.100086 dv-cinder-815582-10-iscsi devstack@n-api.service[134656]: spawned uWSGI worker 2 (pid: 134667, cores: 1) Jun 23 13:38:27.100242 dv-cinder-815582-10-iscsi devstack@n-api.service[134656]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 13:38:27.750871 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 13:38:27.752521 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 13:38:28.942578 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 13:38:28.942578 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: from cryptography.utils import int_from_bytes Jun 23 13:38:28.943291 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 13:38:28.943291 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: from cryptography.utils import int_from_bytes Jun 23 13:38:28.946932 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 13:38:28.946932 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: from cryptography.utils import int_from_bytes Jun 23 13:38:28.947464 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 13:38:28.947464 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: from cryptography.utils import int_from_bytes Jun 23 13:38:31.351142 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 13:38:31.351832 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 13:38:31.351927 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 13:38:31.352246 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 13:38:31.352506 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 13:38:31.352905 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.353235 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.353564 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.353886 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.354219 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.354536 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.354933 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.355264 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.355629 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.355897 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.356218 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.356547 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-10-iscsi {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.356876 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.357190 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.357510 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.357851 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.358147 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.358472 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.358782 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.359286 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.360677 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.360677 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.360677 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.361078 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.361195 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 13:38:31.361577 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.361652 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 13:38:31.361722 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.361934 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 13:38:31.362152 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.362381 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.362601 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 13:38:31.362601 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 13:38:31.362995 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.362995 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.363445 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.363445 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.363882 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-10-iscsi {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.364082 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.364297 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.364505 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.364717 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.364717 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.365139 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.365139 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.365555 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.365762 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.365968 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.365968 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.366361 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.366545 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.366758 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.366918 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.367104 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.367261 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.367456 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.368686 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.368784 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815582-10-iscsi {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.368861 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.368945 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.369025 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.369098 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.369182 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.369266 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.369345 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.369424 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.369495 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.369576 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.369664 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.369746 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.369824 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.369924 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.370009 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.370009 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.370162 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.370256 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.370380 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.370473 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.370547 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.370630 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.370708 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.370779 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.370849 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.370926 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.371005 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.371084 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.371459 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.371573 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.371663 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.371746 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.371834 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.371913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.372156 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.372264 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.372476 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.372584 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.372781 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.372934 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815582-10-iscsi {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.373089 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.373258 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.373403 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.373576 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.373716 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.373897 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.374028 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.374308 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.374494 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.374616 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.374821 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.374947 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.375250 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.375413 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.375589 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.375710 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.375911 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.376031 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.376317 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.376440 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.376563 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.376684 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.376868 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.377105 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.377234 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.377432 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.377570 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.377760 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.377882 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.378069 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.378200 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.378381 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.378521 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.378701 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.378836 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.379027 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.379159 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.379353 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.379475 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.379687 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.379822 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.379940 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.380071 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.380236 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.380366 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.380565 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.380710 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.380871 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.381001 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.381187 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.381328 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.381447 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.381563 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.381678 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.381820 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.381987 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.382117 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.382314 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.382438 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.383044 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.383217 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.383422 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.383573 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.383723 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.383873 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.384026 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.384176 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.384330 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.384489 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.384489 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.384769 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.384923 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.385074 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.385224 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.385375 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.385524 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.385674 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.385829 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.386009 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.386156 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.386305 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.386472 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.386620 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.386788 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.386788 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.387076 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.387236 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.387398 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.387558 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.387710 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.387710 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.387988 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.388140 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.388289 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.388455 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.388604 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.388756 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.388914 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.389076 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.389296 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.389535 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.389683 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.389825 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.389986 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.390137 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.390280 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.390438 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.390606 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.390835 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.390995 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.391144 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.391288 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.391488 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.391634 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.391634 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.391919 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.392063 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.392212 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.392372 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.392601 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.392601 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.392993 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.393144 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.393288 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.393430 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.393579 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.393737 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.393880 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.394021 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.394168 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.394312 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.394463 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.394626 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.394770 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.394925 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.395077 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.395220 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.395394 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.395555 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.395707 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.395857 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.396013 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.396163 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.396311 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.396472 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.396626 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.396776 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.396927 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.397077 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.397244 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.397396 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.397396 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.397678 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.397821 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.397973 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.398130 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.398279 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.398432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.398575 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.398717 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.398877 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.399020 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.399161 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.399328 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.399659 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.399820 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.399973 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.400124 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.400277 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.400429 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.400583 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.400727 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.400891 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.401119 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.401275 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.401516 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.401729 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.401875 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.402024 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.402175 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.402318 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.402469 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.402629 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.402873 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.403108 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.403263 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.403494 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.403656 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.403807 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.403951 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.404101 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.404254 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.404399 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.404558 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.404707 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.404707 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.405012 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.405012 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.405291 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.405434 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.405576 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.405717 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.405866 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.406010 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.406168 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.406319 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.406469 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.406612 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.406765 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.406915 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.406915 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.407232 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.407435 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.407593 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.407743 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.407894 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.408038 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.408189 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 13:38:31.408341 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.408341 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.408619 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.408784 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.408927 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.409083 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.409237 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.409387 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.409531 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.409822 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.409976 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.410123 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.410264 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.410414 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.410564 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.410722 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.410874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.411025 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.411273 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.411453 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.411598 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.411740 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.411898 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.412048 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.412048 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.412331 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.412480 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.412630 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.412794 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.413023 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.413272 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.413428 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.413579 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.413735 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.413878 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.414027 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.414177 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.414329 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.414471 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.414627 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.414770 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.414930 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.415073 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.415215 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.415400 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.415400 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.415691 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.415833 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.415981 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.416130 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.416280 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.416437 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.416587 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.416730 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.416890 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.417033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.417033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.417492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.417636 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.417787 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.417938 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.418090 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.418833 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.418985 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.419136 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.419309 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.419477 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.419632 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.419889 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.420046 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.420198 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.420198 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.420469 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.420613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.420763 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.420906 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.421061 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.421215 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.421475 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.421626 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.421777 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.421926 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.422079 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.422232 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.422383 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.422526 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.422677 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.422820 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.422820 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.423209 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.423512 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.423676 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.423829 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.423988 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.424139 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.424289 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.424439 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.424582 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.424725 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.424875 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.425026 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.425177 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.425320 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.425474 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.425624 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.425624 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.425915 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.426067 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.426210 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.426353 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.426495 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.426650 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.426801 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.426952 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.427102 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.427262 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.427531 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.427688 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.427688 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.427970 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.428122 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.428266 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.428495 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.428643 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.428795 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.428946 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.429089 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.429245 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.429408 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.429559 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.429702 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.429869 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.430098 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.430245 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.430396 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.430548 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.430691 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.430842 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.430988 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.431144 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.431297 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.431474 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.431716 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.431865 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.432008 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.432165 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.432165 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.432446 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.432597 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.432749 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.432968 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.433358 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.433451 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.433558 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.433651 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.433747 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.433747 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.433899 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.433986 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.434070 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.434161 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.434246 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.434336 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.434427 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.434512 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.434605 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.434695 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.434907 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.435024 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.435246 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.435359 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.435622 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.435713 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.435944 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.436050 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.436266 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.436366 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.436589 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.436703 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.436904 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.437051 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.437223 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.437359 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.437552 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.437711 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.437870 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.438021 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.438193 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.438331 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.438511 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.438648 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.438838 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.438980 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.439156 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.439259 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.439509 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.439605 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.439821 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.439915 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.440144 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.440273 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.440453 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.440557 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.440781 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.440891 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.441099 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.441215 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.441409 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.441508 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.441717 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.441857 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.442024 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.442114 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.442336 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.442439 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.442655 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.442753 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.442966 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.443088 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.443278 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.443443 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.443625 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.443727 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.443943 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.444040 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.444257 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.444361 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.444575 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.444668 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.444899 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.445026 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.445213 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.445389 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.445535 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.445691 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.445832 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.445969 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.446115 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.446253 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.446418 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.446557 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.446727 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.446877 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.447029 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.447191 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.447367 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.447529 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.447805 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.447955 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.448107 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.448261 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.448412 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.448597 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.448750 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.448902 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.449060 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.449327 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.449485 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.449629 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.449782 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.449942 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.450088 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.450319 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.450468 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.450620 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.450763 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.450920 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.451072 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.451215 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.451402 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.451562 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.451724 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.451889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.452042 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.452185 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.452335 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.452494 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.452758 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.452917 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.453071 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.453223 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.453373 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.453528 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.453671 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.453822 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.453966 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.454109 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.454259 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.454403 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.454559 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.454710 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.454853 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.454995 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.455226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.455507 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.455679 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.455827 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.455970 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.456120 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.456272 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.456415 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.456566 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.456566 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.456855 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.457008 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.457008 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.457292 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.457292 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.457660 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.457957 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.458116 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.458261 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.458415 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.458566 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.458711 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.458852 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.458994 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.459145 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.459304 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.459490 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.459490 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.459777 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.459928 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.460071 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.460222 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.460460 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.460609 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.460770 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.460923 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.461067 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.461210 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.461352 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.461496 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.461662 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.462178 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.462329 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.462474 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.462617 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.462617 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.463021 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.463169 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.463321 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.463487 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.463632 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.463775 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.463930 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.464137 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.464298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.464452 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.464614 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.464772 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.464923 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.465073 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.465243 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.465462 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.465716 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.465880 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.466025 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.466176 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.466339 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.466485 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.466635 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.466789 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.466941 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.467092 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.467244 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.467422 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.467584 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.467738 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.468032 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.468185 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.468343 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.468493 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.468646 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.468799 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.468952 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.469096 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.469238 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.469389 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.469546 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.469697 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.469841 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.469984 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.470134 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.470288 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.470458 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.470670 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.470817 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.470960 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.471103 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.471255 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.471440 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.471596 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.471748 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.471902 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.472047 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.472204 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.472361 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.472512 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.472656 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.472807 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.472952 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.473207 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.473357 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.473357 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.473646 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.473797 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.473948 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.474109 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.474271 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.474414 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.474558 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.474700 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.474856 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.475008 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.475008 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.475283 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.475477 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.475707 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.475946 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.476103 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.476248 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.476413 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.476566 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.476724 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.476868 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.477010 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.477175 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.477338 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.477490 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.477633 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.477785 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.477929 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.478208 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.478371 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.478539 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.478691 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.478842 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.478994 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.479145 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.479303 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.479473 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.479618 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.479800 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.479945 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.480088 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.480277 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.480424 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.480581 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.480816 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.480964 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.481116 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.481268 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.481420 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.481564 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.481714 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.481860 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.482014 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.482166 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.482310 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.482464 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.482615 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.482758 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.482910 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.483061 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.483222 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.483522 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.483677 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.483821 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.483974 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.484118 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.484261 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.484404 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.484559 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.484712 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.484856 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.485000 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.485143 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.485292 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.485436 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.485596 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.485832 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.486082 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.486232 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.486375 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.486528 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.486692 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.486845 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.486997 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.487141 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.487284 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.487449 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.487682 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.487838 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.487990 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.488265 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.488426 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.488582 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.488734 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.488890 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.489033 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.489183 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.489332 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.489486 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.489631 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.489735 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.489821 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.489914 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.490005 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.490103 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.490196 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.490289 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.490373 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.490464 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.490548 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.490640 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.490640 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.490824 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.490918 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.491003 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.491093 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.491186 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.491271 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.491432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.491594 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.491750 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.491871 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.492073 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.492163 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.492399 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.492488 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.492717 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.492821 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.493027 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.493124 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.493337 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.493434 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.493651 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.493834 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.493961 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.494053 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.494274 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.494372 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.494589 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.494690 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.494906 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.494998 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.495228 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.495387 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.495643 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.495743 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.495965 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.496093 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.496275 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.496392 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.496581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.496693 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.496891 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.496993 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.497209 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.497431 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.497591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.497779 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.497871 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.498091 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.498190 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.498434 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.498588 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.498778 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.498870 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.499091 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.499183 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.499424 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.499534 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.499735 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.499825 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.500096 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.500193 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.500411 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.500511 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.500784 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.500875 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.501097 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.501188 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.501415 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.501530 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.501735 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.501838 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.502053 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.502149 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.502370 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.502468 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.502681 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.502772 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.502999 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.503102 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.503379 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.503485 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.503700 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.503812 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.504051 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.504164 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.504357 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.504458 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.504665 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.504767 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.504981 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.505083 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.505292 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.505406 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.505617 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.505766 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.505928 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.506127 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.506279 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.506519 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.506664 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.506804 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.506952 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.507096 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.507236 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.507436 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.507611 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.507764 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.507929 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.508080 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.508237 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.508397 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.508607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.508748 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.508907 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.509047 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.509194 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.509333 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.509478 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.509617 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.509766 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.509905 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.510043 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.510211 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.510348 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.510500 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.510648 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.510788 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.510943 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.511087 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.511236 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.511405 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.511544 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.511746 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.511893 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.512047 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.512149 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.512370 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.512461 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.512679 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.512778 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.513006 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.513098 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.513335 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.513426 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.513643 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.513745 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.513954 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.514067 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.514256 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.514389 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.514581 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.514704 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.514893 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.515022 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.515203 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.515366 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.515543 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.515708 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.515848 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.516020 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.516163 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.516330 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.516473 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.516653 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.516915 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.517034 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.517230 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.517341 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.517542 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.517653 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.517847 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.517951 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.518158 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.518267 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.518486 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.518592 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.518782 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.518894 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.519093 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.519187 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.519416 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.519513 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.519747 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.519838 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.520059 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.520153 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.520387 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.520481 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.520706 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.520805 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.521038 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.521202 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.521361 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.521501 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.521649 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.521801 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.521936 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.522084 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.522246 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.522413 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.522560 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.522714 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.522861 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.523014 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.523154 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.523293 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.523460 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.523611 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.523751 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.523903 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.524141 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.524287 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.524435 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.524579 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.524739 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.524892 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.525106 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.525248 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.525446 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.525584 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.525752 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.525905 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.526075 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.526218 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.526386 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.526534 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.526779 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.526927 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.527094 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.527235 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.527432 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.527572 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.527753 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.527890 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.528065 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.528208 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.528378 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.528529 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.528776 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.528912 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.529049 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.529197 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.529343 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.529482 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.529636 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.529774 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.529923 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.530071 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.530219 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.530376 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.530522 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.530660 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.530801 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.530959 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.531096 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.531234 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.531427 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.531541 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.531744 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.531845 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.532057 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.532226 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.532409 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.532553 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.532717 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.532853 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.533027 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.533178 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.533320 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.533468 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.533616 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.533758 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.533929 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.534078 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.534225 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.534371 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.534534 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.534670 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.534850 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.534995 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.535163 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.535304 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.535493 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.535629 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.535798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.535942 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.536121 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.536262 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.536419 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.536557 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.536739 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.536875 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.537037 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.537186 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.537363 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.537508 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.537688 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.537823 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.538022 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.538158 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.538341 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.538572 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.538713 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.538911 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.539049 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.539230 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.539395 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.539542 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.539690 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.539885 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.540033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.540175 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.540316 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.540482 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.540620 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.540810 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.540949 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.541141 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.541310 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.541456 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.541610 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.541747 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.541884 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.542035 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.542203 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.542396 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.542540 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.542727 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.542869 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.543056 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.543204 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.543378 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.543482 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.543677 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.543770 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.543991 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.544090 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.544298 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.544433 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.544605 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.544697 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.544913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.545008 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.545222 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.545317 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.545525 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.545615 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.545827 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.545927 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.546128 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.546226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.546454 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.546598 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.546759 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.546851 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.547081 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.547171 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.547415 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.547529 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.547748 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.547839 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.548055 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.548147 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.548358 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.548464 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.548704 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.548796 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.549011 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.549113 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.549344 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.549437 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.549661 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.549752 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.549981 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.550071 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.550304 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.550397 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.550609 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.550706 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.550928 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.551134 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.551234 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.551482 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.551576 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.551824 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.551918 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.552155 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.552329 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.552489 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.552586 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.552812 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.552923 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.553136 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.553228 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.553472 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.553571 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.553786 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.553878 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.554103 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.554195 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.554424 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.554549 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.554741 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.554959 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.555063 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.555288 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.555415 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.555630 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.555729 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.555944 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.556044 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.556256 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.556348 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.556574 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.556665 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.556889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.557136 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.557239 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.557495 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.557620 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.557823 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.557952 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.558165 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.558267 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.558497 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.558589 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.558816 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.558918 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.559131 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.559233 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.559485 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.559582 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.559800 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.559894 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.560108 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.560205 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.560423 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.560513 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.560740 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.560831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.561050 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.561140 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.561362 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.561460 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.561680 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.561809 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.561990 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.562088 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.562296 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.562396 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.562607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.562698 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.562915 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.563005 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.563222 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.563320 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.563562 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.563662 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.563875 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.563966 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.564184 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.564283 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.564492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.564590 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.564801 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.564891 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.565115 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.565265 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.565420 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.565558 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.565697 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.565842 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.566018 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.566158 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.566326 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.566482 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.566630 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.566780 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.566935 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.567083 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.567233 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.567500 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.567649 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.567818 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.567972 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.568152 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.568288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.568478 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.568625 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.568805 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.568942 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.569135 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.569331 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.569470 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.569604 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.569749 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.569885 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.570048 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.570195 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.570336 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.570485 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.570641 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.570777 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.570943 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.571087 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.571249 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.571703 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.571874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.572023 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.572168 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.572307 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.572450 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.572559 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.572745 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.572893 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.573039 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.573177 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.573486 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.573639 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.573802 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.573950 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.574116 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.574257 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.574448 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.574596 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.574767 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.574926 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.575091 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.575226 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.575448 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.575600 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.575776 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.575916 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.576085 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.576234 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.576381 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.576528 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.576698 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.576794 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.577013 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.577142 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.577318 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.577418 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.577623 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.577728 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.577936 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.578093 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.578251 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.578392 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.578532 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.578679 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.578838 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.578988 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.579127 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.579266 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.579527 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.579668 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.579816 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.579967 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.580120 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.580259 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.580398 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.580540 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.580678 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.580835 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.580983 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.581122 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.581261 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.581399 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.581545 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.581692 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.581830 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.581975 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.582116 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.582268 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.582426 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.582589 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.582740 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.582877 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.583017 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.583232 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.583404 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.583573 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.583710 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.583882 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.584030 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.584233 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.584383 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.584555 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.584706 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.584852 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.584998 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.585148 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.585285 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.585432 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.585579 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.585742 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.585884 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.586062 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.586203 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.586379 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.586538 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.586677 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.587198 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.587388 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.587527 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.587703 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.587854 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.588149 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.588292 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.588462 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.588611 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.588773 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.588914 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.589092 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.589329 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.589469 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.589574 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.589758 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.589868 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.590066 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.590171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.590379 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.590474 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.590698 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.590798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.591006 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.591111 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.591313 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.591462 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.591646 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.591746 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.591934 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.592077 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.592312 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.592457 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.592594 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.592733 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.592878 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.592977 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.593142 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.593234 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.593449 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.593587 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.593736 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.593882 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.594030 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.594183 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.594328 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.594474 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.594623 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.594768 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.594918 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.595067 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.595225 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.595392 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.595560 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.595704 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.595850 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.595989 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.596188 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.596341 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.596510 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.596649 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.596830 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.597036 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.597174 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.597357 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.597508 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.597671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.597820 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.597983 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.598130 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.598308 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.598446 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.598639 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.598777 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.598956 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.599111 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.599249 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.599442 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.599641 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.599783 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.599958 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.600091 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.600277 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.600412 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.600597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.600735 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.600914 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.601047 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.601346 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.601451 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.601538 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.601676 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.601867 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.601989 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.602201 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.602313 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.602513 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.602624 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.602841 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.602943 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.603165 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.603258 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.603520 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.603615 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.603842 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.603942 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.604157 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.604249 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.604487 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.604591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.604815 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.604916 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.605126 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.605264 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.605440 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.605548 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.605749 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.605848 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.606055 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.606147 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.606361 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.606465 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.606669 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.606760 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.606973 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.607065 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.607276 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.607467 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.607605 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.607722 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.607908 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.608058 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.608223 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.608390 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.608524 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.608744 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.608843 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.609063 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.609163 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.609401 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.609490 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.609703 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.609811 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.610002 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.610103 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.610311 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.610414 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.610615 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.610713 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.610869 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134667) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 13:38:31.610961 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.611203 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.611550 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.611852 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.612180 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.612513 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.612830 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.613150 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.613458 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.613779 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.614085 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.614402 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.614721 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.615035 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.615355 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.615716 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.616027 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.616340 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.616648 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.616960 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.617268 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.617580 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.617906 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.618230 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.618536 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.618858 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.619178 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.619529 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.619846 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.620155 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.620533 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.620842 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.621151 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.621466 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.621776 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.622086 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.622402 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.622716 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.623039 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.623383 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.623696 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.624022 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.624346 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.624691 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.625005 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.625350 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.625679 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.625992 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.626303 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.626610 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 13:38:31.626850 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=134666) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 13:38:31.673074 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO dbcounter [None req-dd5ba712-fdf4-4c0a-a0c4-d5c74e0dd8ee None None] Registered counter for database nova_api Jun 23 13:38:31.688077 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO dbcounter [None req-c1648df1-1fbe-4540-9887-979774093ef7 None None] Registered counter for database nova_api Jun 23 13:38:31.693918 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_db.sqlalchemy.engines [None req-dd5ba712-fdf4-4c0a-a0c4-d5c74e0dd8ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134667) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 13:38:31.701281 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writer thread running {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 13:38:31.710460 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_db.sqlalchemy.engines [None req-c1648df1-1fbe-4540-9887-979774093ef7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134666) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 13:38:31.717654 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writer thread running {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 13:38:31.759232 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.context [None req-dd5ba712-fdf4-4c0a-a0c4-d5c74e0dd8ee None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0(cell1) {{(pid=134667) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 13:38:31.763377 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-dd5ba712-fdf4-4c0a-a0c4-d5c74e0dd8ee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:38:31.765060 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-dd5ba712-fdf4-4c0a-a0c4-d5c74e0dd8ee None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:38:31.765804 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-dd5ba712-fdf4-4c0a-a0c4-d5c74e0dd8ee None None] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:38:31.767823 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-dd5ba712-fdf4-4c0a-a0c4-d5c74e0dd8ee None None] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:38:31.769892 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO dbcounter [None req-dd5ba712-fdf4-4c0a-a0c4-d5c74e0dd8ee None None] Registered counter for database nova_cell0 Jun 23 13:38:31.772814 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.context [None req-c1648df1-1fbe-4540-9887-979774093ef7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0(cell1) {{(pid=134666) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 13:38:31.773989 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO dbcounter [None req-dd5ba712-fdf4-4c0a-a0c4-d5c74e0dd8ee None None] Registered counter for database nova_cell1 Jun 23 13:38:31.777005 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c1648df1-1fbe-4540-9887-979774093ef7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:38:31.778472 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c1648df1-1fbe-4540-9887-979774093ef7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:38:31.779261 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c1648df1-1fbe-4540-9887-979774093ef7 None None] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:38:31.781336 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c1648df1-1fbe-4540-9887-979774093ef7 None None] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:38:31.781646 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_db.sqlalchemy.engines [None req-dd5ba712-fdf4-4c0a-a0c4-d5c74e0dd8ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134667) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 13:38:31.783020 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_db.sqlalchemy.engines [None req-dd5ba712-fdf4-4c0a-a0c4-d5c74e0dd8ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134667) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 13:38:31.783445 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO dbcounter [None req-c1648df1-1fbe-4540-9887-979774093ef7 None None] Registered counter for database nova_cell0 Jun 23 13:38:31.787477 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO dbcounter [None req-c1648df1-1fbe-4540-9887-979774093ef7 None None] Registered counter for database nova_cell1 Jun 23 13:38:31.790172 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writer thread running {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 13:38:31.791475 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writer thread running {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 13:38:31.794483 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_db.sqlalchemy.engines [None req-c1648df1-1fbe-4540-9887-979774093ef7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134666) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 13:38:31.796778 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_db.sqlalchemy.engines [None req-c1648df1-1fbe-4540-9887-979774093ef7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134666) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 13:38:31.802338 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writer thread running {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 13:38:31.803679 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writer thread running {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 13:38:31.940592 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO dbcounter [None req-dd5ba712-fdf4-4c0a-a0c4-d5c74e0dd8ee None None] Registered counter for database nova_cell0 Jun 23 13:38:31.947818 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_db.sqlalchemy.engines [None req-dd5ba712-fdf4-4c0a-a0c4-d5c74e0dd8ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134667) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 13:38:31.953136 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO dbcounter [None req-c1648df1-1fbe-4540-9887-979774093ef7 None None] Registered counter for database nova_cell0 Jun 23 13:38:31.954151 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writer thread running {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 13:38:31.962808 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_db.sqlalchemy.engines [None req-c1648df1-1fbe-4540-9887-979774093ef7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=134666) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 13:38:31.967491 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writer thread running {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 13:38:32.274868 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: WARNING keystonemiddleware.auth_token [None req-dd5ba712-fdf4-4c0a-a0c4-d5c74e0dd8ee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 13:38:32.278287 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: WARNING keystonemiddleware.auth_token [None req-c1648df1-1fbe-4540-9887-979774093ef7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 13:38:32.282402 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: WARNING keystonemiddleware.auth_token [None req-dd5ba712-fdf4-4c0a-a0c4-d5c74e0dd8ee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 13:38:32.285738 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: WARNING keystonemiddleware.auth_token [None req-c1648df1-1fbe-4540-9887-979774093ef7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 13:38:32.627673 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: WARNING keystonemiddleware.auth_token [None req-c1648df1-1fbe-4540-9887-979774093ef7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 13:38:32.633625 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: WARNING keystonemiddleware.auth_token [None req-c1648df1-1fbe-4540-9887-979774093ef7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 13:38:32.633858 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: WARNING keystonemiddleware.auth_token [None req-dd5ba712-fdf4-4c0a-a0c4-d5c74e0dd8ee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 13:38:32.639087 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562e0202b9c0 pid: 134666 (default app) Jun 23 13:38:32.640089 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: WARNING keystonemiddleware.auth_token [None req-dd5ba712-fdf4-4c0a-a0c4-d5c74e0dd8ee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 13:38:32.645487 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562e0202b9c0 pid: 134667 (default app) Jun 23 13:39:12.021346 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_api:SELECT=3 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:12.021346 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell0:SELECT=3 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:12.021346 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:SELECT=3 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:12.021346 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell0:SELECT=3 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:12.775326 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_api:SELECT=3 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:12.776934 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell0:SELECT=3 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:12.778248 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=3 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:12.779007 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell0:SELECT=3 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:13.794098 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-b0d6d8ad-a91e-4fbd-b9a1-5b1ff8a8505a tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] Action: 'create', calling method: .version_select at 0x7fd7743c1700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-298777241"}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:39:14.378308 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-40c7bf2b-da1a-4834-94ba-9755c73de092 tempest-VolumesNegativeTest-1847403832 tempest-VolumesNegativeTest-1847403832-project] Action: 'create', calling method: .version_select at 0x7fd7743be700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1314927582", "metadata": {"Type": "work"}}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:39:14.402772 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-40c7bf2b-da1a-4834-94ba-9755c73de092 tempest-VolumesNegativeTest-1847403832 tempest-VolumesNegativeTest-1847403832-project] Request method failure captured: Jun 23 13:39:14.402772 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 13:39:14.402772 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:39:14.402772 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:39:14.402772 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:39:14.402772 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 122 Jun 23 13:39:14.402772 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:39:14.402772 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:39:14.402772 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:39:14.402772 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:39:14.402772 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitG0AmbMZzDy88dTDQa6csTcL9zfrvjQ-BJeeZ7cH3GuNcgcCGlfIb-CZeXGvgPyoQaUfHhtfxgWDa1vx1sAi-PomqyyaWNQQpC0lFh7iJSKmVqmYYULmxylDenkiqptB2ZDic6WkmaSFhOeXS6aPrfIpV-viVXytc3X0u5b0Bk40akM Jun 23 13:39:14.402772 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:39:14.402772 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:39:14.402772 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:39:14.402772 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:39:14.402772 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:39:14.402772 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:39:14.402772 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: 83deb4e68e0742afb3144d0d13909f2a Jun 23 13:39:14.402772 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-VolumesNegativeTest-1847403832 Jun 23 13:39:14.402772 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:39:14.402772 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:39:14.404345 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/83deb4e68e0742afb3144d0d13909f2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/83deb4e68e0742afb3144d0d13909f2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/83deb4e68e0742afb3144d0d13909f2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_83deb4e68e0742afb3144d0d13909f2a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:39:14.404345 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-VolumesNegativeTest-1847403832 Jun 23 13:39:14.404345 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: 83deb4e68e0742afb3144d0d13909f2a Jun 23 13:39:14.404345 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-VolumesNegativeTest-1847403832 Jun 23 13:39:14.404345 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-VolumesNegativeTest-1847403832-project Jun 23 13:39:14.404345 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:39:14.404345 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:39:14.404345 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: d410d46bde014275a0da489a2c37ac8c Jun 23 13:39:14.404345 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-VolumesNegativeTest-1847403832-project Jun 23 13:39:14.404345 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Jun 23 13:39:14.404345 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1314927582", "metadata": {"Type": "work"}}} Jun 23 13:39:14.404345 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: Jun 23 13:39:14.404345 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 13:39:14.405174 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1314927582', 'metadata': {'Type': 'work'}}}} Jun 23 13:39:14.405174 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:39:14.405174 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:14.405174 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 13:39:14.405174 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 13:39:14.405174 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 13:39:14.405174 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise error Jun 23 13:39:14.405174 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 23 13:39:14.405174 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:14.405174 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 23 13:39:14.405174 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 13:39:14.405174 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:14.405174 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 13:39:14.405174 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi '#$%' Jun 23 13:39:14.405174 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:14.405174 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:39:14.405174 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:14.405174 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:14.405174 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:39:14.405174 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:39:14.405174 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:39:14.405174 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:39:14.407408 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 13:39:14.407408 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 13:39:14.407408 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:39:14.407408 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:39:14.407408 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 13:39:14.407408 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 13:39:14.407408 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 13:39:14.407408 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 13:39:14.407408 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 13:39:14.407408 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 13:39:14.407408 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 13:39:14.407408 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:14.407408 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:39:14.407408 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:14.407408 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:14.407408 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:39:14.407408 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:39:14.407408 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 13:39:14.407408 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 13:39:14.410153 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 13:39:14.410153 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:14.410153 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-40c7bf2b-da1a-4834-94ba-9755c73de092 tempest-VolumesNegativeTest-1847403832 tempest-VolumesNegativeTest-1847403832-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:39:14.410153 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-40c7bf2b-da1a-4834-94ba-9755c73de092 tempest-VolumesNegativeTest-1847403832 tempest-VolumesNegativeTest-1847403832-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.635499 Jun 23 13:39:14.411689 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1155 bytes} [Thu Jun 23 13:39:12 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1643 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 13:39:14.417419 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-1a86f0b9-4192-4de4-b6f2-df5f9fc6d225 tempest-VolumesNegativeTest-1847403832 tempest-VolumesNegativeTest-1847403832-project] Action: 'create', calling method: .version_select at 0x7fd7743449d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1710654985", "metadata": {"Type": "work"}}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:39:14.425737 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-1a86f0b9-4192-4de4-b6f2-df5f9fc6d225 tempest-VolumesNegativeTest-1847403832 tempest-VolumesNegativeTest-1847403832-project] Request method failure captured: Jun 23 13:39:14.425737 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 13:39:14.425737 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:39:14.425737 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:39:14.425737 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:39:14.425737 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 120 Jun 23 13:39:14.425737 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:39:14.425737 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:39:14.425737 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:39:14.425737 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:39:14.425737 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitG0AmbMZzDy88dTDQa6csTcL9zfrvjQ-BJeeZ7cH3GuNcgcCGlfIb-CZeXGvgPyoQaUfHhtfxgWDa1vx1sAi-PomqyyaWNQQpC0lFh7iJSKmVqmYYULmxylDenkiqptB2ZDic6WkmaSFhOeXS6aPrfIpV-viVXytc3X0u5b0Bk40akM Jun 23 13:39:14.425737 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:39:14.425737 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:39:14.425737 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:39:14.425737 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:39:14.425737 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:39:14.425737 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:39:14.425737 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: 83deb4e68e0742afb3144d0d13909f2a Jun 23 13:39:14.425737 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-VolumesNegativeTest-1847403832 Jun 23 13:39:14.425737 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:39:14.425737 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:39:14.427044 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/83deb4e68e0742afb3144d0d13909f2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/83deb4e68e0742afb3144d0d13909f2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/83deb4e68e0742afb3144d0d13909f2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_83deb4e68e0742afb3144d0d13909f2a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:39:14.427044 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-VolumesNegativeTest-1847403832 Jun 23 13:39:14.427044 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: 83deb4e68e0742afb3144d0d13909f2a Jun 23 13:39:14.427044 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-VolumesNegativeTest-1847403832 Jun 23 13:39:14.427044 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-VolumesNegativeTest-1847403832-project Jun 23 13:39:14.427044 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:39:14.427044 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:39:14.427044 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: d410d46bde014275a0da489a2c37ac8c Jun 23 13:39:14.427044 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-VolumesNegativeTest-1847403832-project Jun 23 13:39:14.427044 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Jun 23 13:39:14.427044 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1710654985", "metadata": {"Type": "work"}}} Jun 23 13:39:14.427044 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: Jun 23 13:39:14.427044 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 13:39:14.428062 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1710654985', 'metadata': {'Type': 'work'}}}} Jun 23 13:39:14.428062 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:39:14.428062 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:14.428062 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 13:39:14.428062 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 13:39:14.428062 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 13:39:14.428062 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise error Jun 23 13:39:14.428062 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 23 13:39:14.428062 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:14.428062 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 23 13:39:14.428062 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 13:39:14.428062 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:14.428062 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 13:39:14.428062 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi '0' Jun 23 13:39:14.428062 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:14.428062 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:39:14.428062 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:14.428062 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:14.428062 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:39:14.428062 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:39:14.428062 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:39:14.428062 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:39:14.429329 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 13:39:14.429329 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 13:39:14.429329 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:39:14.429329 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:39:14.429329 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 13:39:14.429329 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 13:39:14.429329 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 13:39:14.429329 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 13:39:14.429329 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 13:39:14.429329 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 13:39:14.429329 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 13:39:14.429329 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:14.429329 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:39:14.429329 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:14.429329 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:14.429329 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:39:14.429329 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:39:14.429329 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 13:39:14.429329 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 13:39:14.430425 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 13:39:14.430425 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:14.430425 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-1a86f0b9-4192-4de4-b6f2-df5f9fc6d225 tempest-VolumesNegativeTest-1847403832 tempest-VolumesNegativeTest-1847403832-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:39:14.431327 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-1a86f0b9-4192-4de4-b6f2-df5f9fc6d225 tempest-VolumesNegativeTest-1847403832 tempest-VolumesNegativeTest-1847403832-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.014204 Jun 23 13:39:14.436568 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 2/2] 10.222.0.26 () {60 vars in 1155 bytes} [Thu Jun 23 13:39:14 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 13:39:14.444616 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-8c20a0d2-bce1-48b2-85ec-e7e2b97209b8 tempest-VolumesNegativeTest-1847403832 tempest-VolumesNegativeTest-1847403832-project] Action: 'create', calling method: .version_select at 0x7fd7743bea60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-682151518", "metadata": {"Type": "work"}}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:39:14.448379 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-8c20a0d2-bce1-48b2-85ec-e7e2b97209b8 tempest-VolumesNegativeTest-1847403832 tempest-VolumesNegativeTest-1847403832-project] Request method failure captured: Jun 23 13:39:14.448379 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 13:39:14.448379 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:39:14.448379 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:39:14.448379 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:39:14.448379 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 118 Jun 23 13:39:14.448379 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:39:14.448379 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:39:14.448379 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:39:14.448379 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:39:14.448379 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitG0AmbMZzDy88dTDQa6csTcL9zfrvjQ-BJeeZ7cH3GuNcgcCGlfIb-CZeXGvgPyoQaUfHhtfxgWDa1vx1sAi-PomqyyaWNQQpC0lFh7iJSKmVqmYYULmxylDenkiqptB2ZDic6WkmaSFhOeXS6aPrfIpV-viVXytc3X0u5b0Bk40akM Jun 23 13:39:14.448379 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:39:14.448379 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:39:14.448379 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:39:14.448379 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:39:14.448379 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:39:14.448379 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:39:14.448379 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: 83deb4e68e0742afb3144d0d13909f2a Jun 23 13:39:14.448379 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-VolumesNegativeTest-1847403832 Jun 23 13:39:14.448379 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:39:14.448379 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:39:14.449913 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/83deb4e68e0742afb3144d0d13909f2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/83deb4e68e0742afb3144d0d13909f2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/83deb4e68e0742afb3144d0d13909f2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_83deb4e68e0742afb3144d0d13909f2a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:39:14.449913 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-VolumesNegativeTest-1847403832 Jun 23 13:39:14.449913 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: 83deb4e68e0742afb3144d0d13909f2a Jun 23 13:39:14.449913 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-VolumesNegativeTest-1847403832 Jun 23 13:39:14.449913 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-VolumesNegativeTest-1847403832-project Jun 23 13:39:14.449913 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:39:14.449913 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:39:14.449913 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: d410d46bde014275a0da489a2c37ac8c Jun 23 13:39:14.449913 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-VolumesNegativeTest-1847403832-project Jun 23 13:39:14.449913 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Jun 23 13:39:14.449913 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-682151518", "metadata": {"Type": "work"}}} Jun 23 13:39:14.449913 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: Jun 23 13:39:14.449913 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 13:39:14.450751 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-682151518', 'metadata': {'Type': 'work'}}}} Jun 23 13:39:14.450751 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:39:14.450751 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:14.450751 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 13:39:14.450751 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 13:39:14.450751 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 13:39:14.450751 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise error Jun 23 13:39:14.450751 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 23 13:39:14.450751 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:14.450751 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 23 13:39:14.450751 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 13:39:14.450751 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:14.450751 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 13:39:14.450751 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi '' Jun 23 13:39:14.450751 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:14.450751 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:39:14.450751 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:14.450751 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:14.450751 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:39:14.450751 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:39:14.450751 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:39:14.450751 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:39:14.452479 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 13:39:14.452479 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 13:39:14.452479 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:39:14.452479 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:39:14.452479 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 13:39:14.452479 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 13:39:14.452479 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 13:39:14.452479 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 13:39:14.452479 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 13:39:14.452479 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 13:39:14.452479 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 13:39:14.452479 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:14.452479 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:39:14.452479 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:14.452479 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:14.452479 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:39:14.452479 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:39:14.452479 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 13:39:14.452479 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 13:39:14.455065 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 13:39:14.455065 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:14.467195 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-8c20a0d2-bce1-48b2-85ec-e7e2b97209b8 tempest-VolumesNegativeTest-1847403832 tempest-VolumesNegativeTest-1847403832-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:39:14.468472 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-8c20a0d2-bce1-48b2-85ec-e7e2b97209b8 tempest-VolumesNegativeTest-1847403832 tempest-VolumesNegativeTest-1847403832-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.030645 Jun 23 13:39:14.476253 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 3/3] 10.222.0.26 () {60 vars in 1155 bytes} [Thu Jun 23 13:39:14 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 13:39:14.485251 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-830734b6-a2b4-4a16-8e01-2542ff736ab4 tempest-VolumesNegativeTest-1847403832 tempest-VolumesNegativeTest-1847403832-project] Calling method '.version_select at 0x7fd774268700>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:15.177127 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.wsgi [None req-830734b6-a2b4-4a16-8e01-2542ff736ab4 tempest-VolumesNegativeTest-1847403832 tempest-VolumesNegativeTest-1847403832-project] HTTP exception thrown: Volume tempest-invalid-2117539059 could not be found. Jun 23 13:39:15.181033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-830734b6-a2b4-4a16-8e01-2542ff736ab4 tempest-VolumesNegativeTest-1847403832 tempest-VolumesNegativeTest-1847403832-project] Request method failure captured: Jun 23 13:39:15.181033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2117539059 HTTP/1.1 Jun 23 13:39:15.181033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:39:15.181033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:39:15.181033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:39:15.181033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 0 Jun 23 13:39:15.181033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:39:15.181033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:39:15.181033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:39:15.181033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:39:15.181033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitG0AmbMZzDy88dTDQa6csTcL9zfrvjQ-BJeeZ7cH3GuNcgcCGlfIb-CZeXGvgPyoQaUfHhtfxgWDa1vx1sAi-PomqyyaWNQQpC0lFh7iJSKmVqmYYULmxylDenkiqptB2ZDic6WkmaSFhOeXS6aPrfIpV-viVXytc3X0u5b0Bk40akM Jun 23 13:39:15.181033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:39:15.181033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:39:15.181033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:39:15.181033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:39:15.181033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:39:15.181033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:39:15.181033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: 83deb4e68e0742afb3144d0d13909f2a Jun 23 13:39:15.181033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-VolumesNegativeTest-1847403832 Jun 23 13:39:15.181033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:39:15.181033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:39:15.182613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/83deb4e68e0742afb3144d0d13909f2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/83deb4e68e0742afb3144d0d13909f2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/83deb4e68e0742afb3144d0d13909f2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_83deb4e68e0742afb3144d0d13909f2a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:39:15.182613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-VolumesNegativeTest-1847403832 Jun 23 13:39:15.182613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: 83deb4e68e0742afb3144d0d13909f2a Jun 23 13:39:15.182613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-VolumesNegativeTest-1847403832 Jun 23 13:39:15.182613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-VolumesNegativeTest-1847403832-project Jun 23 13:39:15.182613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:39:15.182613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:39:15.182613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: d410d46bde014275a0da489a2c37ac8c Jun 23 13:39:15.182613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-VolumesNegativeTest-1847403832-project Jun 23 13:39:15.182613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: Jun 23 13:39:15.182613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Volume tempest-invalid-2117539059 could not be found. Jun 23 13:39:15.182613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'id': 'tempest-invalid-2117539059'} Jun 23 13:39:15.182613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:39:15.183572 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:15.183572 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 13:39:15.183572 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 13:39:15.183572 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 13:39:15.183572 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 13:39:15.183572 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 13:39:15.183572 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 13:39:15.183572 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 13:39:15.183572 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 13:39:15.183572 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 13:39:15.183572 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 13:39:15.183572 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 13:39:15.183572 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 13:39:15.183572 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 13:39:15.183572 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 13:39:15.183572 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2117539059 could not be found. (HTTP 404) (Request-ID: req-74e9cdd1-9a39-4099-a7ed-c6206d783693) Jun 23 13:39:15.183572 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:15.183572 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:39:15.183572 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:15.185132 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:15.185132 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 13:39:15.185132 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 13:39:15.185132 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 13:39:15.185132 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 13:39:15.185132 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 13:39:15.185132 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 13:39:15.185132 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 13:39:15.185132 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 13:39:15.185132 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 13:39:15.185132 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 13:39:15.185132 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 13:39:15.185132 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 13:39:15.185132 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 13:39:15.185132 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 13:39:15.185132 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 13:39:15.185132 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 13:39:15.185132 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 13:39:15.185132 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 13:39:15.186550 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 13:39:15.186550 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 13:39:15.186550 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 13:39:15.186550 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 13:39:15.186550 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2117539059 could not be found. Jun 23 13:39:15.186550 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:15.186550 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:39:15.186550 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:15.186550 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:15.186550 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:39:15.186550 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:39:15.186550 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:39:15.186550 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:39:15.186550 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 13:39:15.186550 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 13:39:15.186550 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:39:15.186550 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:39:15.186550 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 13:39:15.186550 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:39:15.186550 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2117539059 could not be found. Jun 23 13:39:15.188006 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:15.188006 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:39:15.188006 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:15.188006 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:15.188006 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:39:15.188006 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:39:15.188006 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:39:15.188006 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:39:15.188006 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2117539059 could not be found. Jun 23 13:39:15.188006 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:15.189905 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-830734b6-a2b4-4a16-8e01-2542ff736ab4 tempest-VolumesNegativeTest-1847403832 tempest-VolumesNegativeTest-1847403832-project] Returning 404 to user: Volume tempest-invalid-2117539059 could not be found. {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:39:15.191602 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-830734b6-a2b4-4a16-8e01-2542ff736ab4 tempest-VolumesNegativeTest-1847403832 tempest-VolumesNegativeTest-1847403832-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2117539059" status: 404 len: 99 microversion: 2.1 time: 0.713463 Jun 23 13:39:15.199716 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 4/4] 10.222.0.26 () {58 vars in 1217 bytes} [Thu Jun 23 13:39:14 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2117539059 => generated 99 bytes in 723 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 23 13:39:15.210140 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-ca321860-8b6d-4013-b0c2-051ebb8ca4d6 tempest-VolumesNegativeTest-1847403832 tempest-VolumesNegativeTest-1847403832-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008732 Jun 23 13:39:15.223017 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 5/5] 10.222.0.26 () {58 vars in 1139 bytes} [Thu Jun 23 13:39:15 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 23 13:39:15.229024 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-177df3fa-4608-4166-8424-e1a942a28616 tempest-VolumesNegativeTest-1847403832 tempest-VolumesNegativeTest-1847403832-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004350 Jun 23 13:39:15.234408 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 6/6] 10.222.0.26 () {58 vars in 1136 bytes} [Thu Jun 23 13:39:15 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 23 13:39:15.242947 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-f1f6289b-7179-42b7-b727-a8134717dc92 tempest-VolumesNegativeTest-1847403832 tempest-VolumesNegativeTest-1847403832-project] Calling method '.version_select at 0x7fd77424d9d0>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:15.331838 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.wsgi [None req-f1f6289b-7179-42b7-b727-a8134717dc92 tempest-VolumesNegativeTest-1847403832 tempest-VolumesNegativeTest-1847403832-project] HTTP exception thrown: Volume ee8766aa-d7f6-48bb-a44b-2fc029a19267 could not be found. Jun 23 13:39:15.336922 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-f1f6289b-7179-42b7-b727-a8134717dc92 tempest-VolumesNegativeTest-1847403832 tempest-VolumesNegativeTest-1847403832-project] Request method failure captured: Jun 23 13:39:15.336922 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: DELETE /compute/v2.1/os-volumes/ee8766aa-d7f6-48bb-a44b-2fc029a19267 HTTP/1.1 Jun 23 13:39:15.336922 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:39:15.336922 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:39:15.336922 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:39:15.336922 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 0 Jun 23 13:39:15.336922 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:39:15.336922 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:39:15.336922 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:39:15.336922 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:39:15.336922 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitG0AmbMZzDy88dTDQa6csTcL9zfrvjQ-BJeeZ7cH3GuNcgcCGlfIb-CZeXGvgPyoQaUfHhtfxgWDa1vx1sAi-PomqyyaWNQQpC0lFh7iJSKmVqmYYULmxylDenkiqptB2ZDic6WkmaSFhOeXS6aPrfIpV-viVXytc3X0u5b0Bk40akM Jun 23 13:39:15.336922 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:39:15.336922 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:39:15.336922 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:39:15.336922 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:39:15.336922 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:39:15.336922 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:39:15.336922 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: 83deb4e68e0742afb3144d0d13909f2a Jun 23 13:39:15.336922 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-VolumesNegativeTest-1847403832 Jun 23 13:39:15.336922 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:39:15.336922 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:39:15.339387 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/83deb4e68e0742afb3144d0d13909f2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/83deb4e68e0742afb3144d0d13909f2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/83deb4e68e0742afb3144d0d13909f2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_83deb4e68e0742afb3144d0d13909f2a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:39:15.339387 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-VolumesNegativeTest-1847403832 Jun 23 13:39:15.339387 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: 83deb4e68e0742afb3144d0d13909f2a Jun 23 13:39:15.339387 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-VolumesNegativeTest-1847403832 Jun 23 13:39:15.339387 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-VolumesNegativeTest-1847403832-project Jun 23 13:39:15.339387 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:39:15.339387 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:39:15.339387 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: d410d46bde014275a0da489a2c37ac8c Jun 23 13:39:15.339387 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-VolumesNegativeTest-1847403832-project Jun 23 13:39:15.339387 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: Jun 23 13:39:15.339387 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Volume ee8766aa-d7f6-48bb-a44b-2fc029a19267 could not be found. Jun 23 13:39:15.339387 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'id': 'ee8766aa-d7f6-48bb-a44b-2fc029a19267'} Jun 23 13:39:15.339387 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:39:15.340285 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:15.340285 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 13:39:15.340285 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 13:39:15.340285 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 13:39:15.340285 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 13:39:15.340285 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 13:39:15.340285 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 13:39:15.340285 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 13:39:15.340285 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 13:39:15.340285 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 13:39:15.340285 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 13:39:15.340285 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 13:39:15.340285 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 13:39:15.340285 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 13:39:15.340285 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 13:39:15.340285 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ee8766aa-d7f6-48bb-a44b-2fc029a19267 could not be found. (HTTP 404) (Request-ID: req-f3bd7fea-85b2-469a-94a7-277d5f4079dc) Jun 23 13:39:15.340285 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:15.340285 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:39:15.340285 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:15.341532 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:15.341532 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 13:39:15.341532 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 13:39:15.341532 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 13:39:15.341532 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 13:39:15.341532 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 13:39:15.341532 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 13:39:15.341532 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 13:39:15.341532 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 13:39:15.341532 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 13:39:15.341532 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 13:39:15.341532 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 13:39:15.341532 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 13:39:15.341532 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 13:39:15.341532 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 13:39:15.341532 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 13:39:15.341532 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 13:39:15.341532 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 13:39:15.341532 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 13:39:15.343791 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 13:39:15.343791 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 13:39:15.343791 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 13:39:15.343791 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 13:39:15.343791 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ee8766aa-d7f6-48bb-a44b-2fc029a19267 could not be found. Jun 23 13:39:15.343791 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:15.343791 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:39:15.343791 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:15.343791 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:15.343791 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:39:15.343791 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:39:15.343791 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:39:15.343791 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:39:15.343791 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 13:39:15.343791 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 13:39:15.343791 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:39:15.343791 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:39:15.343791 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 13:39:15.343791 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:39:15.345009 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ee8766aa-d7f6-48bb-a44b-2fc029a19267 could not be found. Jun 23 13:39:15.345009 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:15.345009 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:39:15.345009 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:15.345009 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:15.345009 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:39:15.345009 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:39:15.345009 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:39:15.345009 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:39:15.345009 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ee8766aa-d7f6-48bb-a44b-2fc029a19267 could not be found. Jun 23 13:39:15.345009 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:15.345009 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-f1f6289b-7179-42b7-b727-a8134717dc92 tempest-VolumesNegativeTest-1847403832 tempest-VolumesNegativeTest-1847403832-project] Returning 404 to user: Volume ee8766aa-d7f6-48bb-a44b-2fc029a19267 could not be found. {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:39:15.345009 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-f1f6289b-7179-42b7-b727-a8134717dc92 tempest-VolumesNegativeTest-1847403832 tempest-VolumesNegativeTest-1847403832-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/ee8766aa-d7f6-48bb-a44b-2fc029a19267" status: 404 len: 109 microversion: 2.1 time: 0.103071 Jun 23 13:39:15.345009 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 7/7] 10.222.0.26 () {58 vars in 1247 bytes} [Thu Jun 23 13:39:15 2022] DELETE /compute/v2.1/os-volumes/ee8766aa-d7f6-48bb-a44b-2fc029a19267 => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:39:15.377579 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-a20dc762-3e9a-4e97-aad0-3aa88cebae9a tempest-VolumesNegativeTest-1847403832 tempest-VolumesNegativeTest-1847403832-project] Calling method '.version_select at 0x7fd774344ee0>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:15.496702 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.wsgi [None req-a20dc762-3e9a-4e97-aad0-3aa88cebae9a tempest-VolumesNegativeTest-1847403832 tempest-VolumesNegativeTest-1847403832-project] HTTP exception thrown: Volume 31ec4f13-b5ae-424f-ae10-8558a2f9578a could not be found. Jun 23 13:39:15.499972 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-a20dc762-3e9a-4e97-aad0-3aa88cebae9a tempest-VolumesNegativeTest-1847403832 tempest-VolumesNegativeTest-1847403832-project] Request method failure captured: Jun 23 13:39:15.499972 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: GET /compute/v2.1/os-volumes/31ec4f13-b5ae-424f-ae10-8558a2f9578a HTTP/1.1 Jun 23 13:39:15.499972 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:39:15.499972 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:39:15.499972 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:39:15.499972 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 0 Jun 23 13:39:15.499972 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:39:15.499972 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:39:15.499972 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:39:15.499972 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:39:15.499972 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitG0AmbMZzDy88dTDQa6csTcL9zfrvjQ-BJeeZ7cH3GuNcgcCGlfIb-CZeXGvgPyoQaUfHhtfxgWDa1vx1sAi-PomqyyaWNQQpC0lFh7iJSKmVqmYYULmxylDenkiqptB2ZDic6WkmaSFhOeXS6aPrfIpV-viVXytc3X0u5b0Bk40akM Jun 23 13:39:15.499972 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:39:15.499972 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:39:15.499972 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:39:15.499972 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:39:15.499972 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:39:15.499972 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:39:15.499972 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: 83deb4e68e0742afb3144d0d13909f2a Jun 23 13:39:15.499972 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-VolumesNegativeTest-1847403832 Jun 23 13:39:15.499972 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:39:15.499972 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:39:15.501280 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/83deb4e68e0742afb3144d0d13909f2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/83deb4e68e0742afb3144d0d13909f2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/83deb4e68e0742afb3144d0d13909f2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_83deb4e68e0742afb3144d0d13909f2a", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:39:15.501280 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-VolumesNegativeTest-1847403832 Jun 23 13:39:15.501280 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: 83deb4e68e0742afb3144d0d13909f2a Jun 23 13:39:15.501280 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-VolumesNegativeTest-1847403832 Jun 23 13:39:15.501280 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-VolumesNegativeTest-1847403832-project Jun 23 13:39:15.501280 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:39:15.501280 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:39:15.501280 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: d410d46bde014275a0da489a2c37ac8c Jun 23 13:39:15.501280 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-VolumesNegativeTest-1847403832-project Jun 23 13:39:15.501280 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: Jun 23 13:39:15.501280 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Volume 31ec4f13-b5ae-424f-ae10-8558a2f9578a could not be found. Jun 23 13:39:15.501280 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'id': '31ec4f13-b5ae-424f-ae10-8558a2f9578a'} Jun 23 13:39:15.501280 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:39:15.502046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:15.502046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 13:39:15.502046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 13:39:15.502046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 13:39:15.502046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 13:39:15.502046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 13:39:15.502046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 13:39:15.502046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 13:39:15.502046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 13:39:15.502046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 13:39:15.502046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 13:39:15.502046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 13:39:15.502046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 13:39:15.502046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 13:39:15.502046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 13:39:15.502046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 31ec4f13-b5ae-424f-ae10-8558a2f9578a could not be found. (HTTP 404) (Request-ID: req-40440e43-e234-4f88-a6d9-0048b50f862b) Jun 23 13:39:15.502046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:15.502046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:39:15.502046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:15.503394 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:15.503394 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 13:39:15.503394 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 13:39:15.503394 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 13:39:15.503394 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 13:39:15.503394 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 13:39:15.503394 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 13:39:15.503394 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 13:39:15.503394 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 13:39:15.503394 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 13:39:15.503394 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 13:39:15.503394 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 13:39:15.503394 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 13:39:15.503394 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 13:39:15.503394 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 13:39:15.503394 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 13:39:15.503394 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 13:39:15.503394 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 13:39:15.503394 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 13:39:15.505204 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 13:39:15.505204 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 13:39:15.505204 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 13:39:15.505204 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 13:39:15.505204 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 31ec4f13-b5ae-424f-ae10-8558a2f9578a could not be found. Jun 23 13:39:15.505204 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:15.505204 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:39:15.505204 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:15.505204 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:15.505204 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:39:15.505204 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:39:15.505204 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:39:15.505204 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:39:15.505204 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 13:39:15.505204 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 13:39:15.505204 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:39:15.505204 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:39:15.505204 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 13:39:15.505204 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:39:15.506295 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 31ec4f13-b5ae-424f-ae10-8558a2f9578a could not be found. Jun 23 13:39:15.506295 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:15.506295 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:39:15.506295 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:15.506295 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:15.506295 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:39:15.506295 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:39:15.506295 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:39:15.506295 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:39:15.506295 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 31ec4f13-b5ae-424f-ae10-8558a2f9578a could not be found. Jun 23 13:39:15.506295 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:15.509029 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-a20dc762-3e9a-4e97-aad0-3aa88cebae9a tempest-VolumesNegativeTest-1847403832 tempest-VolumesNegativeTest-1847403832-project] Returning 404 to user: Volume 31ec4f13-b5ae-424f-ae10-8558a2f9578a could not be found. {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:39:15.509971 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-a20dc762-3e9a-4e97-aad0-3aa88cebae9a tempest-VolumesNegativeTest-1847403832 tempest-VolumesNegativeTest-1847403832-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/31ec4f13-b5ae-424f-ae10-8558a2f9578a" status: 404 len: 109 microversion: 2.1 time: 0.150463 Jun 23 13:39:15.520050 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 8/8] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Jun 23 13:39:15 2022] GET /compute/v2.1/os-volumes/31ec4f13-b5ae-424f-ae10-8558a2f9578a => generated 109 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:39:15.854189 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-b0d6d8ad-a91e-4fbd-b9a1-5b1ff8a8505a tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.856938 Jun 23 13:39:15.855786 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 1/9] 10.222.0.26 () {60 vars in 1154 bytes} [Thu Jun 23 13:39:11 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3860 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 23 13:39:15.868108 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-93cf1862-3454-4921-bbf9-dcfcfd60027d tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] Calling method '.version_select at 0x7fd77424d280>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:16.053897 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-93cf1862-3454-4921-bbf9-dcfcfd60027d tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed" status: 200 len: 344 microversion: 2.1 time: 0.190104 Jun 23 13:39:16.055529 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 9/10] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Jun 23 13:39:15 2022] GET /compute/v2.1/os-volumes/4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed => generated 344 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:39:17.068798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-acd32af6-926d-47c0-a12a-729c343dfab7 tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] Calling method '.version_select at 0x7fd774287550>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:17.155642 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-acd32af6-926d-47c0-a12a-729c343dfab7 tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed" status: 200 len: 345 microversion: 2.1 time: 0.091016 Jun 23 13:39:17.156221 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 2/11] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Jun 23 13:39:17 2022] GET /compute/v2.1/os-volumes/4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed => generated 345 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:39:17.167314 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-dad0b12d-0f27-48c0-a67a-aa0b63c1f7cb tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] Action: 'create', calling method: .version_select at 0x7fd77424d700>, body: {"snapshot": {"volume_id": "4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1013771971"}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:39:17.629316 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-dad0b12d-0f27-48c0-a67a-aa0b63c1f7cb tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.464889 Jun 23 13:39:17.631171 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 10/12] 10.222.0.26 () {60 vars in 1161 bytes} [Thu Jun 23 13:39:17 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:39:17.644372 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-da12f72f-3d68-4064-ab3e-88b4dd2279f8 tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] Calling method '.version_select at 0x7fd774287820>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:17.741618 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-da12f72f-3d68-4064-ab3e-88b4dd2279f8 tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/d953df63-35b5-43a2-a751-ac62673efae6" status: 200 len: 287 microversion: 2.1 time: 0.104424 Jun 23 13:39:17.742891 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 3/13] 10.222.0.26 () {58 vars in 1250 bytes} [Thu Jun 23 13:39:17 2022] GET /compute/v2.1/os-snapshots/d953df63-35b5-43a2-a751-ac62673efae6 => generated 287 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:39:17.752856 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-57b97937-168b-4fa8-ac7f-8f5b1438a4e1 tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] Calling method '.version_select at 0x7fd774344af0>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:17.824922 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-57b97937-168b-4fa8-ac7f-8f5b1438a4e1 tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.076136 Jun 23 13:39:17.826900 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 11/14] 10.222.0.26 () {58 vars in 1139 bytes} [Thu Jun 23 13:39:17 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:39:17.838328 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-54acf73c-aace-460f-a04f-8b8268279ff3 tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] Calling method '.version_select at 0x7fd774287dc0>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:17.887081 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-54acf73c-aace-460f-a04f-8b8268279ff3 tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/d953df63-35b5-43a2-a751-ac62673efae6" status: 200 len: 287 microversion: 2.1 time: 0.053794 Jun 23 13:39:17.889965 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 4/15] 10.222.0.26 () {58 vars in 1250 bytes} [Thu Jun 23 13:39:17 2022] GET /compute/v2.1/os-snapshots/d953df63-35b5-43a2-a751-ac62673efae6 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 13:39:18.899950 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-ba9e75cb-1163-46e6-90b8-77abd8ec990b tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] Calling method '.version_select at 0x7fd7741a9a60>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:18.964498 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-ba9e75cb-1163-46e6-90b8-77abd8ec990b tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/d953df63-35b5-43a2-a751-ac62673efae6" status: 200 len: 287 microversion: 2.1 time: 0.068257 Jun 23 13:39:18.965474 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 12/16] 10.222.0.26 () {58 vars in 1250 bytes} [Thu Jun 23 13:39:18 2022] GET /compute/v2.1/os-snapshots/d953df63-35b5-43a2-a751-ac62673efae6 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:39:19.978150 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c03697c7-596d-492d-b88f-ffbed9b03ece tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] Calling method '.version_select at 0x7fd77421f4c0>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:20.021394 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-c03697c7-596d-492d-b88f-ffbed9b03ece tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/d953df63-35b5-43a2-a751-ac62673efae6" status: 200 len: 287 microversion: 2.1 time: 0.048537 Jun 23 13:39:20.022399 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 5/17] 10.222.0.26 () {58 vars in 1250 bytes} [Thu Jun 23 13:39:19 2022] GET /compute/v2.1/os-snapshots/d953df63-35b5-43a2-a751-ac62673efae6 => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:39:20.838366 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-ff5454bb-1e0d-45a4-9f3b-f4bb6990f125 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Action: 'create', calling method: .version_select at 0x7fd774344f70>, body: {"keypair": {"name": "tempest-keypair-1534996295", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqpC5Qg5AiSIFv8/QMcJs3Dd64JzR9Df406mWY0fXANl/mLfNZfjKufkxxKGv5XT2YwaZlf8AioMWmmmBqwxopRiHAAFyTv/xp7fRlcGBr+vQO8OomGyTqBVVh5SxVnhw=="}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:39:20.940082 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.quota [None req-ff5454bb-1e0d-45a4-9f3b-f4bb6990f125 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Getting quotas for project 9298bf4635e84993b086309715cc7cbe. Resources: {'key_pairs'} {{(pid=134667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:39:20.959126 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.quota [None req-ff5454bb-1e0d-45a4-9f3b-f4bb6990f125 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Getting quotas for user 007ce9b8109343e0914efe94c6aa6a89 and project 9298bf4635e84993b086309715cc7cbe. Resources: {'key_pairs'} {{(pid=134667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:39:21.035735 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-0463999e-a220-4966-b813-62b68ce2a54e tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] Calling method '.version_select at 0x7fd774287d30>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:21.098464 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-ff5454bb-1e0d-45a4-9f3b-f4bb6990f125 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.840714 Jun 23 13:39:21.099501 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 13/18] 10.222.0.26 () {60 vars in 1158 bytes} [Thu Jun 23 13:39:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:39:21.132847 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-0463999e-a220-4966-b813-62b68ce2a54e tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/d953df63-35b5-43a2-a751-ac62673efae6" status: 200 len: 288 microversion: 2.1 time: 0.102087 Jun 23 13:39:21.148136 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 6/19] 10.222.0.26 () {58 vars in 1250 bytes} [Thu Jun 23 13:39:21 2022] GET /compute/v2.1/os-snapshots/d953df63-35b5-43a2-a751-ac62673efae6 => generated 288 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:39:21.155960 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-b815e048-96f1-4ccd-845e-9613ca941a59 tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] Calling method '.version_select at 0x7fd7741908b0>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:21.322710 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-b815e048-96f1-4ccd-845e-9613ca941a59 tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/d953df63-35b5-43a2-a751-ac62673efae6" status: 202 len: 0 microversion: 2.1 time: 0.180998 Jun 23 13:39:21.323488 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 14/20] 10.222.0.26 () {58 vars in 1253 bytes} [Thu Jun 23 13:39:21 2022] DELETE /compute/v2.1/os-snapshots/d953df63-35b5-43a2-a751-ac62673efae6 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 13:39:21.333716 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-7531740c-2c22-471e-a191-a721d5b48b88 tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] Calling method '.version_select at 0x7fd7742878b0>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:21.412289 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-7531740c-2c22-471e-a191-a721d5b48b88 tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/d953df63-35b5-43a2-a751-ac62673efae6" status: 200 len: 287 microversion: 2.1 time: 0.084332 Jun 23 13:39:21.412861 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 7/21] 10.222.0.26 () {58 vars in 1250 bytes} [Thu Jun 23 13:39:21 2022] GET /compute/v2.1/os-snapshots/d953df63-35b5-43a2-a751-ac62673efae6 => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:39:22.424121 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-31a66fb5-ba64-4b22-85d5-bdee69bb6fe3 tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] Calling method '.version_select at 0x7fd774190af0>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:22.480495 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.wsgi [None req-31a66fb5-ba64-4b22-85d5-bdee69bb6fe3 tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] HTTP exception thrown: Snapshot d953df63-35b5-43a2-a751-ac62673efae6 could not be found. Jun 23 13:39:22.483145 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-31a66fb5-ba64-4b22-85d5-bdee69bb6fe3 tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] Request method failure captured: Jun 23 13:39:22.483145 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: GET /compute/v2.1/os-snapshots/d953df63-35b5-43a2-a751-ac62673efae6 HTTP/1.1 Jun 23 13:39:22.483145 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:39:22.483145 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:39:22.483145 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:39:22.483145 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 0 Jun 23 13:39:22.483145 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:39:22.483145 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:39:22.483145 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:39:22.483145 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:39:22.483145 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitGz_gp3gbTXj2pf3uVG9vlzxXoMehX9HY4s3oGuQcTKbWAok2o9L_M_ac1VKUHTEqcklfiJYeAryy9WRsmRWkoCqwSwuZRuYTBE4gCe2S_7tPFyPDZAdhsjlU1tcPG0XtBtNpguwlQMim6GKGTXKmJ5jvH22pcAbxoWpy7yFmvcMidI Jun 23 13:39:22.483145 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:39:22.483145 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:39:22.483145 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:39:22.483145 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:39:22.483145 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:39:22.483145 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:39:22.483145 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: fea0a1a7e2574c5a8ddc9ff93749c022 Jun 23 13:39:22.483145 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-882862877 Jun 23 13:39:22.483145 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:39:22.483145 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:39:22.484476 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fea0a1a7e2574c5a8ddc9ff93749c022"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fea0a1a7e2574c5a8ddc9ff93749c022"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fea0a1a7e2574c5a8ddc9ff93749c022"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fea0a1a7e2574c5a8ddc9ff93749c022", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:39:22.484476 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-VolumesSnapshotsTestJSON-882862877 Jun 23 13:39:22.484476 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: fea0a1a7e2574c5a8ddc9ff93749c022 Jun 23 13:39:22.484476 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-882862877 Jun 23 13:39:22.484476 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-VolumesSnapshotsTestJSON-882862877-project Jun 23 13:39:22.484476 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:39:22.484476 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:39:22.484476 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: 944d72f95b2a41309feccfc1b6fe8df6 Jun 23 13:39:22.484476 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-VolumesSnapshotsTestJSON-882862877-project Jun 23 13:39:22.484476 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: Jun 23 13:39:22.484476 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Snapshot d953df63-35b5-43a2-a751-ac62673efae6 could not be found. Jun 23 13:39:22.484476 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'id': 'd953df63-35b5-43a2-a751-ac62673efae6'} Jun 23 13:39:22.484476 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:39:22.485294 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:22.485294 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 23 13:39:22.485294 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 23 13:39:22.485294 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 23 13:39:22.485294 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 23 13:39:22.485294 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 23 13:39:22.485294 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 23 13:39:22.485294 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 13:39:22.485294 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 13:39:22.485294 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 13:39:22.485294 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 13:39:22.485294 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 13:39:22.485294 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 13:39:22.485294 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 13:39:22.485294 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 13:39:22.485294 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d953df63-35b5-43a2-a751-ac62673efae6 could not be found. (HTTP 404) (Request-ID: req-afeb762f-031c-4b7b-8f20-7e56724fd1a4) Jun 23 13:39:22.485294 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:22.485294 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:39:22.486338 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:22.486338 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:22.486338 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 23 13:39:22.486338 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 23 13:39:22.486338 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 13:39:22.486338 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 13:39:22.486338 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 23 13:39:22.486338 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 23 13:39:22.486338 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 13:39:22.486338 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 13:39:22.486338 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 23 13:39:22.486338 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 23 13:39:22.486338 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 23 13:39:22.486338 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 23 13:39:22.486338 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 23 13:39:22.486338 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 23 13:39:22.486338 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 13:39:22.486338 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 13:39:22.486338 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 13:39:22.487503 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 13:39:22.487503 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 13:39:22.487503 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 13:39:22.487503 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 13:39:22.487503 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 13:39:22.487503 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d953df63-35b5-43a2-a751-ac62673efae6 could not be found. Jun 23 13:39:22.487503 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:22.487503 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:39:22.487503 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:22.487503 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:22.487503 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:39:22.487503 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:39:22.487503 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:39:22.487503 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:39:22.487503 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 13:39:22.487503 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 13:39:22.487503 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:39:22.487503 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:39:22.487503 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 23 13:39:22.487503 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:39:22.488640 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d953df63-35b5-43a2-a751-ac62673efae6 could not be found. Jun 23 13:39:22.488640 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:22.488640 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:39:22.488640 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:22.488640 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:22.488640 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:39:22.488640 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:39:22.488640 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:39:22.488640 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:39:22.488640 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d953df63-35b5-43a2-a751-ac62673efae6 could not be found. Jun 23 13:39:22.488640 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:22.489278 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-31a66fb5-ba64-4b22-85d5-bdee69bb6fe3 tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] Returning 404 to user: Snapshot d953df63-35b5-43a2-a751-ac62673efae6 could not be found. {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:39:22.490223 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-31a66fb5-ba64-4b22-85d5-bdee69bb6fe3 tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/d953df63-35b5-43a2-a751-ac62673efae6" status: 404 len: 111 microversion: 2.1 time: 0.069935 Jun 23 13:39:22.491050 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 15/22] 10.222.0.26 () {58 vars in 1250 bytes} [Thu Jun 23 13:39:22 2022] GET /compute/v2.1/os-snapshots/d953df63-35b5-43a2-a751-ac62673efae6 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:39:22.499727 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-4ffd71db-996a-447e-96c8-960ea8e0eacf tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] Calling method '.version_select at 0x7fd77421f670>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:22.724541 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-4ffd71db-996a-447e-96c8-960ea8e0eacf tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed" status: 202 len: 0 microversion: 2.1 time: 0.229210 Jun 23 13:39:22.725358 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 8/23] 10.222.0.26 () {58 vars in 1247 bytes} [Thu Jun 23 13:39:22 2022] DELETE /compute/v2.1/os-volumes/4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 13:39:22.734030 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-17c3a8a5-1620-4c44-a806-66343abb813c tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] Calling method '.version_select at 0x7fd7739474c0>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:22.903317 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-17c3a8a5-1620-4c44-a806-66343abb813c tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed" status: 200 len: 344 microversion: 2.1 time: 0.173349 Jun 23 13:39:22.904177 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 16/24] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Jun 23 13:39:22 2022] GET /compute/v2.1/os-volumes/4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed => generated 344 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:39:23.917167 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-93fd9baa-94f8-49ef-9baf-e45e00481e2d tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] Calling method '.version_select at 0x7fd77421fb80>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:23.972690 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.wsgi [None req-93fd9baa-94f8-49ef-9baf-e45e00481e2d tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] HTTP exception thrown: Volume 4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed could not be found. Jun 23 13:39:23.977492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-93fd9baa-94f8-49ef-9baf-e45e00481e2d tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] Request method failure captured: Jun 23 13:39:23.977492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: request: GET /compute/v2.1/os-volumes/4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed HTTP/1.1 Jun 23 13:39:23.977492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept: application/json Jun 23 13:39:23.977492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept-Encoding: identity Jun 23 13:39:23.977492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Connection: close Jun 23 13:39:23.977492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Length: 0 Jun 23 13:39:23.977492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Type: application/json Jun 23 13:39:23.977492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Host: 10.222.0.26 Jun 23 13:39:23.977492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Openstack-System-Scope: None Jun 23 13:39:23.977492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: User-Agent: python-urllib3/1.26.9 Jun 23 13:39:23.977492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Auth-Token: gAAAAABitGz_gp3gbTXj2pf3uVG9vlzxXoMehX9HY4s3oGuQcTKbWAok2o9L_M_ac1VKUHTEqcklfiJYeAryy9WRsmRWkoCqwSwuZRuYTBE4gCe2S_7tPFyPDZAdhsjlU1tcPG0XtBtNpguwlQMim6GKGTXKmJ5jvH22pcAbxoWpy7yFmvcMidI Jun 23 13:39:23.977492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Id: None Jun 23 13:39:23.977492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Name: None Jun 23 13:39:23.977492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Identity-Status: Confirmed Jun 23 13:39:23.977492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Is-Admin-Project: True Jun 23 13:39:23.977492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Id: default Jun 23 13:39:23.977492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Name: Default Jun 23 13:39:23.977492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Id: fea0a1a7e2574c5a8ddc9ff93749c022 Jun 23 13:39:23.977492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-882862877 Jun 23 13:39:23.977492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Role: member,reader Jun 23 13:39:23.977492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Roles: member,reader Jun 23 13:39:23.978544 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fea0a1a7e2574c5a8ddc9ff93749c022"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fea0a1a7e2574c5a8ddc9ff93749c022"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fea0a1a7e2574c5a8ddc9ff93749c022"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fea0a1a7e2574c5a8ddc9ff93749c022", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:39:23.978544 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant: tempest-VolumesSnapshotsTestJSON-882862877 Jun 23 13:39:23.978544 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Id: fea0a1a7e2574c5a8ddc9ff93749c022 Jun 23 13:39:23.978544 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-882862877 Jun 23 13:39:23.978544 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User: tempest-VolumesSnapshotsTestJSON-882862877-project Jun 23 13:39:23.978544 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Id: default Jun 23 13:39:23.978544 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Name: Default Jun 23 13:39:23.978544 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Id: 944d72f95b2a41309feccfc1b6fe8df6 Jun 23 13:39:23.978544 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Name: tempest-VolumesSnapshotsTestJSON-882862877-project Jun 23 13:39:23.978544 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: method: Jun 23 13:39:23.978544 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: exception: Volume 4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed could not be found. Jun 23 13:39:23.978544 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: action_args: {'id': '4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed'} Jun 23 13:39:23.978544 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:39:23.979171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:23.979171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 13:39:23.979171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 13:39:23.979171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 13:39:23.979171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 13:39:23.979171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 13:39:23.979171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 13:39:23.979171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 13:39:23.979171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 13:39:23.979171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 13:39:23.979171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 13:39:23.979171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 13:39:23.979171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 13:39:23.979171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 13:39:23.979171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 13:39:23.979171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed could not be found. (HTTP 404) (Request-ID: req-94b267dd-030c-4a8f-85fd-e564c1e81e8b) Jun 23 13:39:23.979171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:39:23.979171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:39:23.979171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:39:23.980056 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:23.980056 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 13:39:23.980056 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 13:39:23.980056 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 13:39:23.980056 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 13:39:23.980056 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 13:39:23.980056 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 13:39:23.980056 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 13:39:23.980056 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 13:39:23.980056 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 13:39:23.980056 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 13:39:23.980056 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 13:39:23.980056 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 13:39:23.980056 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 13:39:23.980056 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 13:39:23.980056 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 13:39:23.980056 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 13:39:23.980056 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 13:39:23.980056 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 13:39:23.980913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 13:39:23.980913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 13:39:23.980913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 13:39:23.980913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 13:39:23.980913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed could not be found. Jun 23 13:39:23.980913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:39:23.980913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:39:23.980913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:39:23.980913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:23.980913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:39:23.980913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:39:23.980913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:39:23.980913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:39:23.980913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 13:39:23.980913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 13:39:23.980913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:39:23.980913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:39:23.980913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 13:39:23.980913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:39:23.981771 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed could not be found. Jun 23 13:39:23.981771 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:39:23.981771 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:39:23.981771 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:39:23.981771 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:23.981771 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:39:23.981771 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:39:23.981771 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:39:23.981771 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:39:23.981771 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed could not be found. Jun 23 13:39:23.981771 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:39:23.987663 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-93fd9baa-94f8-49ef-9baf-e45e00481e2d tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] Returning 404 to user: Volume 4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed could not be found. {{(pid=134666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:39:23.988747 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-93fd9baa-94f8-49ef-9baf-e45e00481e2d tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed" status: 404 len: 109 microversion: 2.1 time: 0.076051 Jun 23 13:39:23.989821 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 9/25] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Jun 23 13:39:23 2022] GET /compute/v2.1/os-volumes/4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:39:24.003414 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-aceaa994-522c-4474-86e0-e51d18438f01 tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] Calling method '.version_select at 0x7fd774190670>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:24.060842 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.wsgi [None req-aceaa994-522c-4474-86e0-e51d18438f01 tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] HTTP exception thrown: Volume 4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed could not be found. Jun 23 13:39:24.063131 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-aceaa994-522c-4474-86e0-e51d18438f01 tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] Request method failure captured: Jun 23 13:39:24.063131 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: DELETE /compute/v2.1/os-volumes/4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed HTTP/1.1 Jun 23 13:39:24.063131 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:39:24.063131 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:39:24.063131 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:39:24.063131 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 0 Jun 23 13:39:24.063131 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:39:24.063131 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:39:24.063131 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:39:24.063131 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:39:24.063131 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitGz_gp3gbTXj2pf3uVG9vlzxXoMehX9HY4s3oGuQcTKbWAok2o9L_M_ac1VKUHTEqcklfiJYeAryy9WRsmRWkoCqwSwuZRuYTBE4gCe2S_7tPFyPDZAdhsjlU1tcPG0XtBtNpguwlQMim6GKGTXKmJ5jvH22pcAbxoWpy7yFmvcMidI Jun 23 13:39:24.063131 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:39:24.063131 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:39:24.063131 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:39:24.063131 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:39:24.063131 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:39:24.063131 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:39:24.063131 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: fea0a1a7e2574c5a8ddc9ff93749c022 Jun 23 13:39:24.063131 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-882862877 Jun 23 13:39:24.063131 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:39:24.063131 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:39:24.064298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fea0a1a7e2574c5a8ddc9ff93749c022"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fea0a1a7e2574c5a8ddc9ff93749c022"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fea0a1a7e2574c5a8ddc9ff93749c022"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fea0a1a7e2574c5a8ddc9ff93749c022", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:39:24.064298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-VolumesSnapshotsTestJSON-882862877 Jun 23 13:39:24.064298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: fea0a1a7e2574c5a8ddc9ff93749c022 Jun 23 13:39:24.064298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-882862877 Jun 23 13:39:24.064298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-VolumesSnapshotsTestJSON-882862877-project Jun 23 13:39:24.064298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:39:24.064298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:39:24.064298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: 944d72f95b2a41309feccfc1b6fe8df6 Jun 23 13:39:24.064298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-VolumesSnapshotsTestJSON-882862877-project Jun 23 13:39:24.064298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: Jun 23 13:39:24.064298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Volume 4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed could not be found. Jun 23 13:39:24.064298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'id': '4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed'} Jun 23 13:39:24.064298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:39:24.064929 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:24.064929 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 13:39:24.064929 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 13:39:24.064929 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 13:39:24.064929 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 13:39:24.064929 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 13:39:24.064929 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 13:39:24.064929 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 13:39:24.064929 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 13:39:24.064929 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 13:39:24.064929 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 13:39:24.064929 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 13:39:24.064929 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 13:39:24.064929 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 13:39:24.064929 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 13:39:24.064929 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed could not be found. (HTTP 404) (Request-ID: req-4332c483-40e3-4629-81aa-5c3e048f9740) Jun 23 13:39:24.064929 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:24.064929 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:39:24.064929 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:24.069690 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:24.069690 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 13:39:24.069690 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 13:39:24.069690 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 13:39:24.069690 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 13:39:24.069690 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 13:39:24.069690 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 13:39:24.069690 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 13:39:24.069690 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 13:39:24.069690 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 13:39:24.069690 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 13:39:24.069690 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 13:39:24.069690 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 13:39:24.069690 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 13:39:24.069690 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 13:39:24.069690 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 13:39:24.069690 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 13:39:24.069690 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 13:39:24.069690 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 13:39:24.070611 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 13:39:24.070611 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 13:39:24.070611 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 13:39:24.070611 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 13:39:24.070611 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed could not be found. Jun 23 13:39:24.070611 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:24.070611 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:39:24.070611 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:24.070611 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:24.070611 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:39:24.070611 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:39:24.070611 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:39:24.070611 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:39:24.070611 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 13:39:24.070611 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 13:39:24.070611 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:39:24.070611 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:39:24.070611 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 13:39:24.070611 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:39:24.071516 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed could not be found. Jun 23 13:39:24.071516 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:24.071516 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:39:24.071516 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:24.071516 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:24.071516 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:39:24.071516 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:39:24.071516 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:39:24.071516 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:39:24.071516 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed could not be found. Jun 23 13:39:24.071516 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:39:24.071516 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-aceaa994-522c-4474-86e0-e51d18438f01 tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] Returning 404 to user: Volume 4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed could not be found. {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:39:24.071516 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-aceaa994-522c-4474-86e0-e51d18438f01 tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed" status: 404 len: 109 microversion: 2.1 time: 0.069740 Jun 23 13:39:24.071516 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 17/26] 10.222.0.26 () {58 vars in 1247 bytes} [Thu Jun 23 13:39:23 2022] DELETE /compute/v2.1/os-volumes/4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:39:24.076447 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c10c15ed-8f9b-4141-92b5-98e052bc47e5 tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] Calling method '.version_select at 0x7fd77421f790>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:24.143178 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.wsgi [None req-c10c15ed-8f9b-4141-92b5-98e052bc47e5 tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] HTTP exception thrown: Volume 4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed could not be found. Jun 23 13:39:24.145235 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c10c15ed-8f9b-4141-92b5-98e052bc47e5 tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] Request method failure captured: Jun 23 13:39:24.145235 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: request: GET /compute/v2.1/os-volumes/4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed HTTP/1.1 Jun 23 13:39:24.145235 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept: application/json Jun 23 13:39:24.145235 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept-Encoding: identity Jun 23 13:39:24.145235 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Connection: close Jun 23 13:39:24.145235 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Length: 0 Jun 23 13:39:24.145235 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Type: application/json Jun 23 13:39:24.145235 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Host: 10.222.0.26 Jun 23 13:39:24.145235 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Openstack-System-Scope: None Jun 23 13:39:24.145235 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: User-Agent: python-urllib3/1.26.9 Jun 23 13:39:24.145235 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Auth-Token: gAAAAABitGz_gp3gbTXj2pf3uVG9vlzxXoMehX9HY4s3oGuQcTKbWAok2o9L_M_ac1VKUHTEqcklfiJYeAryy9WRsmRWkoCqwSwuZRuYTBE4gCe2S_7tPFyPDZAdhsjlU1tcPG0XtBtNpguwlQMim6GKGTXKmJ5jvH22pcAbxoWpy7yFmvcMidI Jun 23 13:39:24.145235 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Id: None Jun 23 13:39:24.145235 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Name: None Jun 23 13:39:24.145235 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Identity-Status: Confirmed Jun 23 13:39:24.145235 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Is-Admin-Project: True Jun 23 13:39:24.145235 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Id: default Jun 23 13:39:24.145235 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Name: Default Jun 23 13:39:24.145235 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Id: fea0a1a7e2574c5a8ddc9ff93749c022 Jun 23 13:39:24.145235 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-882862877 Jun 23 13:39:24.145235 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Role: member,reader Jun 23 13:39:24.145235 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Roles: member,reader Jun 23 13:39:24.146292 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fea0a1a7e2574c5a8ddc9ff93749c022"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fea0a1a7e2574c5a8ddc9ff93749c022"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fea0a1a7e2574c5a8ddc9ff93749c022"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fea0a1a7e2574c5a8ddc9ff93749c022", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:39:24.146292 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant: tempest-VolumesSnapshotsTestJSON-882862877 Jun 23 13:39:24.146292 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Id: fea0a1a7e2574c5a8ddc9ff93749c022 Jun 23 13:39:24.146292 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-882862877 Jun 23 13:39:24.146292 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User: tempest-VolumesSnapshotsTestJSON-882862877-project Jun 23 13:39:24.146292 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Id: default Jun 23 13:39:24.146292 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Name: Default Jun 23 13:39:24.146292 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Id: 944d72f95b2a41309feccfc1b6fe8df6 Jun 23 13:39:24.146292 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Name: tempest-VolumesSnapshotsTestJSON-882862877-project Jun 23 13:39:24.146292 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: method: Jun 23 13:39:24.146292 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: exception: Volume 4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed could not be found. Jun 23 13:39:24.146292 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: action_args: {'id': '4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed'} Jun 23 13:39:24.146292 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:39:24.146905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:24.146905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 13:39:24.146905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 13:39:24.146905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 13:39:24.146905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 13:39:24.146905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 13:39:24.146905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 13:39:24.146905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 13:39:24.146905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 13:39:24.146905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 13:39:24.146905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 13:39:24.146905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 13:39:24.146905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 13:39:24.146905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 13:39:24.146905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 13:39:24.146905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed could not be found. (HTTP 404) (Request-ID: req-a5ebf5e4-2e27-4ece-bada-f6566375fc1b) Jun 23 13:39:24.146905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:39:24.146905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:39:24.146905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:39:24.150992 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:24.150992 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 13:39:24.150992 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 13:39:24.150992 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 13:39:24.150992 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 13:39:24.150992 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 13:39:24.150992 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 13:39:24.150992 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 13:39:24.150992 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 13:39:24.150992 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 13:39:24.150992 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 13:39:24.150992 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 13:39:24.150992 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 13:39:24.150992 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 13:39:24.150992 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 13:39:24.150992 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 13:39:24.150992 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 13:39:24.150992 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 13:39:24.150992 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 13:39:24.152490 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 13:39:24.152490 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 13:39:24.152490 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 13:39:24.152490 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 13:39:24.152490 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed could not be found. Jun 23 13:39:24.152490 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:39:24.152490 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:39:24.152490 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:39:24.152490 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:24.152490 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:39:24.152490 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:39:24.152490 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:39:24.152490 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:39:24.152490 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 13:39:24.152490 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 13:39:24.152490 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:39:24.152490 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:39:24.152490 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 13:39:24.152490 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:39:24.154874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed could not be found. Jun 23 13:39:24.154874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:39:24.154874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:39:24.154874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:39:24.154874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:39:24.154874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:39:24.154874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:39:24.154874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:39:24.154874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:39:24.154874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed could not be found. Jun 23 13:39:24.154874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:39:24.154874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c10c15ed-8f9b-4141-92b5-98e052bc47e5 tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] Returning 404 to user: Volume 4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed could not be found. {{(pid=134666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:39:24.154874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-c10c15ed-8f9b-4141-92b5-98e052bc47e5 tempest-VolumesSnapshotsTestJSON-882862877 tempest-VolumesSnapshotsTestJSON-882862877-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed" status: 404 len: 109 microversion: 2.1 time: 0.075826 Jun 23 13:39:24.154874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 10/27] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Jun 23 13:39:24 2022] GET /compute/v2.1/os-volumes/4c3c3733-f4f1-4273-8ef4-1b1e21b6f8ed => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:39:30.607713 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-cf2bd26a-12de-41d2-a8b9-112f93432d29 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1906369345", "imageRef": "dd7aacbf-3b3e-496e-967e-53d2a1b1f200", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "750f6de3-a7e6-4721-b369-b46085e03f9a"}], "security_groups": [{"name": "tempest-securitygroup--976631256"}], "key_name": "tempest-keypair-1534996295", "user_data": "}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:39:30.995403 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.network.neutron [None req-cf2bd26a-12de-41d2-a8b9-112f93432d29 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] validate_networks() for [('750f6de3-a7e6-4721-b369-b46085e03f9a', None, None, None, None, None)] {{(pid=134667) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 13:39:31.004639 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell0:SELECT=4 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:31.075934 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-66a3c794-c2b4-4a01-bf5e-319b4980b946 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1110320580", "imageRef": "dd7aacbf-3b3e-496e-967e-53d2a1b1f200", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:39:31.275551 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.network.neutron [None req-66a3c794-c2b4-4a01-bf5e-319b4980b946 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] validate_networks() for [('aa1c1aa4-3e5b-4496-86ec-113ba24a4995', None, None, None, None, None)] {{(pid=134666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 13:39:33.332733 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-66a3c794-c2b4-4a01-bf5e-319b4980b946 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Flavor limits 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 13:39:33.333341 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-66a3c794-c2b4-4a01-bf5e-319b4980b946 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Image limits 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 13:39:33.333613 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-66a3c794-c2b4-4a01-bf5e-319b4980b946 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Flavor pref 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 13:39:33.334018 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-66a3c794-c2b4-4a01-bf5e-319b4980b946 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Image pref 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 13:39:33.334487 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-66a3c794-c2b4-4a01-bf5e-319b4980b946 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 13:39:33.369688 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-cf2bd26a-12de-41d2-a8b9-112f93432d29 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Flavor limits 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 13:39:33.370207 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-cf2bd26a-12de-41d2-a8b9-112f93432d29 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Image limits 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 13:39:33.370583 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-cf2bd26a-12de-41d2-a8b9-112f93432d29 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Flavor pref 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 13:39:33.370987 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-cf2bd26a-12de-41d2-a8b9-112f93432d29 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Image pref 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 13:39:33.371429 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-cf2bd26a-12de-41d2-a8b9-112f93432d29 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 13:39:33.403221 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-66a3c794-c2b4-4a01-bf5e-319b4980b946 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:33.406233 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-cf2bd26a-12de-41d2-a8b9-112f93432d29 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:33.409676 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-cf2bd26a-12de-41d2-a8b9-112f93432d29 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:33.410530 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-cf2bd26a-12de-41d2-a8b9-112f93432d29 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:33.410968 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-cf2bd26a-12de-41d2-a8b9-112f93432d29 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:33.422173 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-66a3c794-c2b4-4a01-bf5e-319b4980b946 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:33.423087 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-66a3c794-c2b4-4a01-bf5e-319b4980b946 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:33.423626 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-66a3c794-c2b4-4a01-bf5e-319b4980b946 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:33.528709 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.quota [None req-cf2bd26a-12de-41d2-a8b9-112f93432d29 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Getting quotas for project 9298bf4635e84993b086309715cc7cbe. Resources: {'ram', 'cores', 'instances'} {{(pid=134667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:39:33.543117 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.quota [None req-cf2bd26a-12de-41d2-a8b9-112f93432d29 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Getting quotas for user 007ce9b8109343e0914efe94c6aa6a89 and project 9298bf4635e84993b086309715cc7cbe. Resources: {'ram', 'cores', 'instances'} {{(pid=134667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:39:33.549391 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-66a3c794-c2b4-4a01-bf5e-319b4980b946 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Getting quotas for project 855cb6e79485414ab0f2a40162231d72. Resources: {'ram', 'cores', 'instances'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:39:33.576152 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-66a3c794-c2b4-4a01-bf5e-319b4980b946 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Getting quotas for user ae510389cfc04a0cb4e6991df2a93a00 and project 855cb6e79485414ab0f2a40162231d72. Resources: {'ram', 'cores', 'instances'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:39:33.607521 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-cf2bd26a-12de-41d2-a8b9-112f93432d29 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Going to run 1 instances... {{(pid=134667) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 13:39:33.610289 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-cf2bd26a-12de-41d2-a8b9-112f93432d29 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7aacbf-3b3e-496e-967e-53d2a1b1f200',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134667) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 13:39:33.635935 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-66a3c794-c2b4-4a01-bf5e-319b4980b946 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Going to run 1 instances... {{(pid=134666) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 13:39:33.648466 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-66a3c794-c2b4-4a01-bf5e-319b4980b946 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7aacbf-3b3e-496e-967e-53d2a1b1f200',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 13:39:33.825429 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-cf2bd26a-12de-41d2-a8b9-112f93432d29 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.223547 Jun 23 13:39:33.831995 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 18/28] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Jun 23 13:39:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 3231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 13:39:33.838831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-d2b5f711-9117-4bbf-8b39-e9e0dead7f9c tempest-VolumesTestJSON-456836519 tempest-VolumesTestJSON-456836519-project] Calling method '.version_select at 0x7fd773864700>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:33.889102 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-66a3c794-c2b4-4a01-bf5e-319b4980b946 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.032267 Jun 23 13:39:33.889749 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 11/29] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Jun 23 13:39:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 3034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 13:39:34.032914 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-d2b5f711-9117-4bbf-8b39-e9e0dead7f9c tempest-VolumesTestJSON-456836519 tempest-VolumesTestJSON-456836519-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/cf7d15b7-d3ce-4e63-8274-0a5d869b8947" status: 200 len: 349 microversion: 2.1 time: 0.198909 Jun 23 13:39:34.033570 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 19/30] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Jun 23 13:39:33 2022] GET /compute/v2.1/os-volumes/cf7d15b7-d3ce-4e63-8274-0a5d869b8947 => generated 349 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:39:34.483602 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-bf23e37e-e442-4fc2-af75-4f00849e1a4d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Action: 'create', calling method: .version_select at 0x7fd77390d280>, body: {"keypair": {"name": "tempest-keypair-378981695", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSfZIZuL4WIQwk1urJpyt9vwcYCHoldyPgB509USz4LkgTGa2CV3os9IAN7JyzYCHNLTF0SvRy6nappxpEPV47OYk/UDeV/2i94Cb4oVqEnQf9HtNDAuut9ub6KIEJGVQ=="}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:39:34.564232 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-bf23e37e-e442-4fc2-af75-4f00849e1a4d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Getting quotas for project 1d89deaaefc541739f67ab1e53c4bda3. Resources: {'key_pairs'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:39:34.576770 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-bf23e37e-e442-4fc2-af75-4f00849e1a4d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Getting quotas for user b191f41e53064acbaf17e3da073e7c85 and project 1d89deaaefc541739f67ab1e53c4bda3. Resources: {'key_pairs'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:39:34.637091 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-bf23e37e-e442-4fc2-af75-4f00849e1a4d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.745801 Jun 23 13:39:34.637711 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 12/31] 10.222.0.26 () {62 vars in 1199 bytes} [Thu Jun 23 13:39:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 747 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 23 13:39:34.652309 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-953746c2-b0e9-4fd8-98db-d700e1369a10 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:34.656308 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-953746c2-b0e9-4fd8-98db-d700e1369a10 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:34.798922 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-294fe811-fc77-47d3-8c9a-a4a1680741cd tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-836172765", "imageRef": "dd7aacbf-3b3e-496e-967e-53d2a1b1f200", "flavorRef": "452", "networks": [{"uuid": "57131c53-e6ce-4332-82cd-06a99ec244f1"}]}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:39:34.985877 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.network.neutron [None req-294fe811-fc77-47d3-8c9a-a4a1680741cd tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] validate_networks() for [('57131c53-e6ce-4332-82cd-06a99ec244f1', None, None, None, None, None)] {{(pid=134667) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 13:39:35.336607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-953746c2-b0e9-4fd8-98db-d700e1369a10 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:35.371971 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-953746c2-b0e9-4fd8-98db-d700e1369a10 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa" status: 200 len: 1242 microversion: 2.1 time: 0.723338 Jun 23 13:39:35.375652 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 13/32] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:34 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa => generated 1242 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:35.399189 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c693571a-8ce1-4021-bd0b-169d0fde0e4d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:35.402377 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-c693571a-8ce1-4021-bd0b-169d0fde0e4d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:35.792735 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-c693571a-8ce1-4021-bd0b-169d0fde0e4d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:35.802709 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-c693571a-8ce1-4021-bd0b-169d0fde0e4d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29" status: 200 len: 1222 microversion: 2.1 time: 0.425751 Jun 23 13:39:35.803282 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 14/33] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:35 2022] GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29 => generated 1222 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:35.830209 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c3fc190f-1f1e-4ea4-883b-3b2b982af627 tempest-VolumesTestJSON-456836519 tempest-VolumesTestJSON-456836519-project] Calling method '.version_select at 0x7fd77285c310>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:35.956177 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-c3fc190f-1f1e-4ea4-883b-3b2b982af627 tempest-VolumesTestJSON-456836519 tempest-VolumesTestJSON-456836519-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/83209b77-d492-4f85-b5b8-169082e174ea" status: 200 len: 350 microversion: 2.1 time: 0.138819 Jun 23 13:39:35.956555 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 15/34] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Jun 23 13:39:35 2022] GET /compute/v2.1/os-volumes/83209b77-d492-4f85-b5b8-169082e174ea => generated 350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:39:36.136837 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-6eb3afdc-ff00-4042-b0ed-4db92949c575 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1512714679", "imageRef": "dd7aacbf-3b3e-496e-967e-53d2a1b1f200", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:39:36.288317 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.network.neutron [None req-6eb3afdc-ff00-4042-b0ed-4db92949c575 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] validate_networks() for [('aa1c1aa4-3e5b-4496-86ec-113ba24a4995', None, None, None, None, None)] {{(pid=134666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 13:39:37.533666 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-294fe811-fc77-47d3-8c9a-a4a1680741cd tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Flavor limits 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 13:39:37.534332 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-294fe811-fc77-47d3-8c9a-a4a1680741cd tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Image limits 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 13:39:37.535229 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-294fe811-fc77-47d3-8c9a-a4a1680741cd tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Flavor pref 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 13:39:37.535755 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-294fe811-fc77-47d3-8c9a-a4a1680741cd tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Image pref 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 13:39:37.536241 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-294fe811-fc77-47d3-8c9a-a4a1680741cd tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 13:39:37.571001 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-294fe811-fc77-47d3-8c9a-a4a1680741cd tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:37.573931 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-294fe811-fc77-47d3-8c9a-a4a1680741cd tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:37.576627 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-294fe811-fc77-47d3-8c9a-a4a1680741cd tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:37.578313 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-294fe811-fc77-47d3-8c9a-a4a1680741cd tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:37.648229 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.quota [None req-294fe811-fc77-47d3-8c9a-a4a1680741cd tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Getting quotas for project 8e4aa13d65ad43b1849bad5bfa99e459. Resources: {'ram', 'cores', 'instances'} {{(pid=134667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:39:37.652191 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.quota [None req-294fe811-fc77-47d3-8c9a-a4a1680741cd tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Getting quotas for user d503b205ca214601a119535611899e95 and project 8e4aa13d65ad43b1849bad5bfa99e459. Resources: {'ram', 'cores', 'instances'} {{(pid=134667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:39:37.681474 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-294fe811-fc77-47d3-8c9a-a4a1680741cd tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Going to run 1 instances... {{(pid=134667) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 13:39:37.689730 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-294fe811-fc77-47d3-8c9a-a4a1680741cd tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7aacbf-3b3e-496e-967e-53d2a1b1f200',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134667) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 13:39:37.810280 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-294fe811-fc77-47d3-8c9a-a4a1680741cd tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.775567 Jun 23 13:39:37.812753 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 20/35] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Jun 23 13:39:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 3779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 13:39:37.830644 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-a0d8fe42-5cd8-4437-9ec7-d8c5265ae06f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:37.834508 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-a0d8fe42-5cd8-4437-9ec7-d8c5265ae06f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:37.867802 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a0d8fe42-5cd8-4437-9ec7-d8c5265ae06f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:37.868571 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a0d8fe42-5cd8-4437-9ec7-d8c5265ae06f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:37.869567 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a0d8fe42-5cd8-4437-9ec7-d8c5265ae06f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:37.870219 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a0d8fe42-5cd8-4437-9ec7-d8c5265ae06f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:38.149521 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-a0d8fe42-5cd8-4437-9ec7-d8c5265ae06f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:38.193792 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-a0d8fe42-5cd8-4437-9ec7-d8c5265ae06f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa" status: 200 len: 1294 microversion: 2.1 time: 0.365277 Jun 23 13:39:38.205323 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 21/36] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:37 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa => generated 1294 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:38.207550 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-bca104d9-260f-4b5d-9882-db5511616895 tempest-VolumesTestJSON-456836519 tempest-VolumesTestJSON-456836519-project] Calling method '.version_select at 0x7fd772800f70>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:38.321245 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-bca104d9-260f-4b5d-9882-db5511616895 tempest-VolumesTestJSON-456836519 tempest-VolumesTestJSON-456836519-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/0e618421-cbf0-48d0-b28f-b5afeb97448e" status: 200 len: 350 microversion: 2.1 time: 0.122991 Jun 23 13:39:38.323391 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 22/37] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Jun 23 13:39:38 2022] GET /compute/v2.1/os-volumes/0e618421-cbf0-48d0-b28f-b5afeb97448e => generated 350 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:39:38.364478 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-5a4a115e-85b0-42f7-bc75-16ffbcdade00 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:38.366661 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-5a4a115e-85b0-42f7-bc75-16ffbcdade00 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:38.450102 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-6eb3afdc-ff00-4042-b0ed-4db92949c575 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Flavor limits 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 13:39:38.450727 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-6eb3afdc-ff00-4042-b0ed-4db92949c575 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Image limits 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 13:39:38.451453 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-6eb3afdc-ff00-4042-b0ed-4db92949c575 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Flavor pref 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 13:39:38.452233 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-6eb3afdc-ff00-4042-b0ed-4db92949c575 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Image pref 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 13:39:38.452891 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-6eb3afdc-ff00-4042-b0ed-4db92949c575 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 13:39:38.484285 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6eb3afdc-ff00-4042-b0ed-4db92949c575 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:38.487746 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6eb3afdc-ff00-4042-b0ed-4db92949c575 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:38.489163 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6eb3afdc-ff00-4042-b0ed-4db92949c575 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:38.491892 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6eb3afdc-ff00-4042-b0ed-4db92949c575 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:38.578015 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-6eb3afdc-ff00-4042-b0ed-4db92949c575 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Getting quotas for project 855cb6e79485414ab0f2a40162231d72. Resources: {'ram', 'cores', 'instances'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:39:38.603301 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-6eb3afdc-ff00-4042-b0ed-4db92949c575 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Getting quotas for user ae510389cfc04a0cb4e6991df2a93a00 and project 855cb6e79485414ab0f2a40162231d72. Resources: {'ram', 'cores', 'instances'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:39:38.661837 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-6eb3afdc-ff00-4042-b0ed-4db92949c575 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Going to run 1 instances... {{(pid=134666) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 13:39:38.670082 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-6eb3afdc-ff00-4042-b0ed-4db92949c575 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7aacbf-3b3e-496e-967e-53d2a1b1f200',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 13:39:38.816655 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-6eb3afdc-ff00-4042-b0ed-4db92949c575 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.683956 Jun 23 13:39:38.817311 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 16/38] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Jun 23 13:39:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 2685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 13:39:38.825338 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-1cd227e8-dc61-4b94-af54-98f7e61bac13 tempest-VolumesTestJSON-456836519 tempest-VolumesTestJSON-456836519-project] Calling method '.version_select at 0x7fd7730d0d30>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:38.945870 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-5a4a115e-85b0-42f7-bc75-16ffbcdade00 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:38.970326 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-5a4a115e-85b0-42f7-bc75-16ffbcdade00 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1214 microversion: 2.1 time: 0.644908 Jun 23 13:39:38.976993 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 23/39] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:38 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1214 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:39.000036 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-d60177d6-a7ee-4848-b796-4101f9f017c5 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:39.007455 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-d60177d6-a7ee-4848-b796-4101f9f017c5 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:39.286696 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-d60177d6-a7ee-4848-b796-4101f9f017c5 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:39.305590 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-1cd227e8-dc61-4b94-af54-98f7e61bac13 tempest-VolumesTestJSON-456836519 tempest-VolumesTestJSON-456836519-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.486938 Jun 23 13:39:39.306386 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 17/40] 10.222.0.26 () {58 vars in 1133 bytes} [Thu Jun 23 13:39:38 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:39.315102 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-776d6e0b-9dc0-4425-bd17-7847d7ca4b66 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:39.316032 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-776d6e0b-9dc0-4425-bd17-7847d7ca4b66 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:39.325486 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-d60177d6-a7ee-4848-b796-4101f9f017c5 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1222 microversion: 2.1 time: 0.335751 Jun 23 13:39:39.329196 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 24/41] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:38 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1222 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:39.347446 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-10b59006-0a4c-4bd2-b0f8-bcfb58494538 tempest-VolumesTestJSON-456836519 tempest-VolumesTestJSON-456836519-project] Calling method '.version_select at 0x7fd7727c4af0>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:39.356762 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-776d6e0b-9dc0-4425-bd17-7847d7ca4b66 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:39.371843 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-776d6e0b-9dc0-4425-bd17-7847d7ca4b66 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:39.373082 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-776d6e0b-9dc0-4425-bd17-7847d7ca4b66 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:39.376925 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-776d6e0b-9dc0-4425-bd17-7847d7ca4b66 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:39.721640 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-10b59006-0a4c-4bd2-b0f8-bcfb58494538 tempest-VolumesTestJSON-456836519 tempest-VolumesTestJSON-456836519-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.387435 Jun 23 13:39:39.722737 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 25/42] 10.222.0.26 () {58 vars in 1148 bytes} [Thu Jun 23 13:39:39 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:39:39.735611 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-4b7291e8-4df4-4ff5-8eb8-f6c50f6792b7 tempest-VolumesTestJSON-456836519 tempest-VolumesTestJSON-456836519-project] Calling method '.version_select at 0x7fd7727d64c0>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:40.078689 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-776d6e0b-9dc0-4425-bd17-7847d7ca4b66 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:40.105033 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-776d6e0b-9dc0-4425-bd17-7847d7ca4b66 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa" status: 200 len: 1300 microversion: 2.1 time: 0.796180 Jun 23 13:39:40.108393 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 18/43] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:39 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa => generated 1300 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:40.119924 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-34933c19-1276-4b5a-9193-95dd46629e62 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:40.122915 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-34933c19-1276-4b5a-9193-95dd46629e62 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:40.138551 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-34933c19-1276-4b5a-9193-95dd46629e62 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:40.139606 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-34933c19-1276-4b5a-9193-95dd46629e62 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:40.140683 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-34933c19-1276-4b5a-9193-95dd46629e62 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:40.141274 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-34933c19-1276-4b5a-9193-95dd46629e62 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:40.171368 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-4b7291e8-4df4-4ff5-8eb8-f6c50f6792b7 tempest-VolumesTestJSON-456836519 tempest-VolumesTestJSON-456836519-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.439923 Jun 23 13:39:40.171932 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 26/44] 10.222.0.26 () {58 vars in 1133 bytes} [Thu Jun 23 13:39:39 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:39:40.183734 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-409b40de-f815-4473-836b-09d3de0c090e tempest-VolumesTestJSON-456836519 tempest-VolumesTestJSON-456836519-project] Calling method '.version_select at 0x7fd7727c4820>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:40.537748 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-409b40de-f815-4473-836b-09d3de0c090e tempest-VolumesTestJSON-456836519 tempest-VolumesTestJSON-456836519-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.358059 Jun 23 13:39:40.538322 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 27/45] 10.222.0.26 () {58 vars in 1166 bytes} [Thu Jun 23 13:39:40 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 13:39:40.550560 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-4944b332-3c1e-4aa4-977c-5b6affcf9524 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:40.555185 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-4944b332-3c1e-4aa4-977c-5b6affcf9524 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:40.574438 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4944b332-3c1e-4aa4-977c-5b6affcf9524 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:40.575243 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4944b332-3c1e-4aa4-977c-5b6affcf9524 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:40.576280 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4944b332-3c1e-4aa4-977c-5b6affcf9524 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:40.576979 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4944b332-3c1e-4aa4-977c-5b6affcf9524 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:41.324065 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-34933c19-1276-4b5a-9193-95dd46629e62 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:41.366068 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-34933c19-1276-4b5a-9193-95dd46629e62 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1274 microversion: 2.1 time: 1.254471 Jun 23 13:39:41.379610 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 19/46] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:40 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1274 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:41.389380 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-bd2ed2e8-60d8-42b4-95a6-f9e62e395f77 tempest-VolumesTestJSON-456836519 tempest-VolumesTestJSON-456836519-project] Calling method '.version_select at 0x7fd7727ebca0>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:41.500702 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-4944b332-3c1e-4aa4-977c-5b6affcf9524 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:41.509213 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-4944b332-3c1e-4aa4-977c-5b6affcf9524 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1218 microversion: 2.1 time: 0.962508 Jun 23 13:39:41.518978 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 28/47] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:40 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1218 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:41.529304 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-bd2ed2e8-60d8-42b4-95a6-f9e62e395f77 tempest-VolumesTestJSON-456836519 tempest-VolumesTestJSON-456836519-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.145937 Jun 23 13:39:41.530927 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 20/48] 10.222.0.26 () {58 vars in 1169 bytes} [Thu Jun 23 13:39:41 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:39:41.543584 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-bf8a29fd-31c5-415a-92f7-e0df543cc6e2 tempest-VolumesTestJSON-456836519 tempest-VolumesTestJSON-456836519-project] Calling method '.version_select at 0x7fd7727a60d0>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:41.552756 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-5f5d553b-3332-4810-82e6-8c95dee334dc tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:41.565807 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-5f5d553b-3332-4810-82e6-8c95dee334dc tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:41.603608 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5f5d553b-3332-4810-82e6-8c95dee334dc tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:41.624302 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5f5d553b-3332-4810-82e6-8c95dee334dc tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:41.626580 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5f5d553b-3332-4810-82e6-8c95dee334dc tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:41.637551 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5f5d553b-3332-4810-82e6-8c95dee334dc tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:41.969183 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-bf8a29fd-31c5-415a-92f7-e0df543cc6e2 tempest-VolumesTestJSON-456836519 tempest-VolumesTestJSON-456836519-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.429588 Jun 23 13:39:41.970080 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 21/49] 10.222.0.26 () {58 vars in 1154 bytes} [Thu Jun 23 13:39:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:39:41.977190 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-2440e2cc-fc00-4e50-b570-28f6423a2130 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1279799168", "imageRef": "dd7aacbf-3b3e-496e-967e-53d2a1b1f200", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "13de077c-d4db-4fa7-84a8-7023d19899e5"}], "security_groups": [{"name": "tempest-securitygroup--903326260"}], "key_name": "tempest-keypair-378981695", "user_data": "}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:39:42.208264 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-5f5d553b-3332-4810-82e6-8c95dee334dc tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:42.221818 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-5f5d553b-3332-4810-82e6-8c95dee334dc tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa" status: 200 len: 1300 microversion: 2.1 time: 0.710795 Jun 23 13:39:42.222871 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 29/50] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:41 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa => generated 1300 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:42.239263 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-c2f53acc-d452-4ea0-a7e7-a991f42a7afa tempest-VolumesTestJSON-456836519 tempest-VolumesTestJSON-456836519-project] Calling method '.version_select at 0x7fd7727d6550>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:42.498111 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-c2f53acc-d452-4ea0-a7e7-a991f42a7afa tempest-VolumesTestJSON-456836519 tempest-VolumesTestJSON-456836519-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.273441 Jun 23 13:39:42.498693 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 30/51] 10.222.0.26 () {58 vars in 1187 bytes} [Thu Jun 23 13:39:42 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:39:42.503175 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-5aac641e-10ba-4e1c-b678-45c89da0925f tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:42.505780 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-5aac641e-10ba-4e1c-b678-45c89da0925f tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:42.533483 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5aac641e-10ba-4e1c-b678-45c89da0925f tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:42.536765 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5aac641e-10ba-4e1c-b678-45c89da0925f tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:42.544139 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5aac641e-10ba-4e1c-b678-45c89da0925f tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:42.546458 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5aac641e-10ba-4e1c-b678-45c89da0925f tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:42.567012 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.network.neutron [None req-2440e2cc-fc00-4e50-b570-28f6423a2130 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] validate_networks() for [('13de077c-d4db-4fa7-84a8-7023d19899e5', None, None, None, None, None)] {{(pid=134666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 13:39:43.204500 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-5aac641e-10ba-4e1c-b678-45c89da0925f tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:43.218196 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-5aac641e-10ba-4e1c-b678-45c89da0925f tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1272 microversion: 2.1 time: 0.718402 Jun 23 13:39:43.233720 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 31/52] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:42 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1272 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:43.252299 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-afcdad99-131f-46e3-82b8-3d516ca9a03c tempest-VolumesTestJSON-456836519 tempest-VolumesTestJSON-456836519-project] Calling method '.version_select at 0x7fd7727d6550>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:43.677966 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-afcdad99-131f-46e3-82b8-3d516ca9a03c tempest-VolumesTestJSON-456836519 tempest-VolumesTestJSON-456836519-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.442587 Jun 23 13:39:43.679488 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 32/53] 10.222.0.26 () {58 vars in 1154 bytes} [Thu Jun 23 13:39:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:43.685659 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-bf7196c1-24b4-4e00-b7bb-f42fb4c72522 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:43.686288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-bf7196c1-24b4-4e00-b7bb-f42fb4c72522 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:43.689680 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=7 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:43.712164 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bf7196c1-24b4-4e00-b7bb-f42fb4c72522 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:43.713319 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bf7196c1-24b4-4e00-b7bb-f42fb4c72522 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:43.716484 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bf7196c1-24b4-4e00-b7bb-f42fb4c72522 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:43.717809 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bf7196c1-24b4-4e00-b7bb-f42fb4c72522 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:45.061204 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-bf7196c1-24b4-4e00-b7bb-f42fb4c72522 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:45.073332 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-bf7196c1-24b4-4e00-b7bb-f42fb4c72522 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1322 microversion: 2.1 time: 1.392760 Jun 23 13:39:45.074056 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 33/54] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:43 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1322 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:45.080573 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-2440e2cc-fc00-4e50-b570-28f6423a2130 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Flavor limits 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 13:39:45.081529 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-2440e2cc-fc00-4e50-b570-28f6423a2130 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Image limits 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 13:39:45.082153 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-2440e2cc-fc00-4e50-b570-28f6423a2130 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Flavor pref 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 13:39:45.082718 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-2440e2cc-fc00-4e50-b570-28f6423a2130 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Image pref 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 13:39:45.083303 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-2440e2cc-fc00-4e50-b570-28f6423a2130 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 13:39:45.087395 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-9378881b-653a-4f18-b4c6-129aba3b8299 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:45.108459 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-9378881b-653a-4f18-b4c6-129aba3b8299 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:45.114566 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2440e2cc-fc00-4e50-b570-28f6423a2130 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:45.115276 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2440e2cc-fc00-4e50-b570-28f6423a2130 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:45.116586 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2440e2cc-fc00-4e50-b570-28f6423a2130 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:45.117343 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2440e2cc-fc00-4e50-b570-28f6423a2130 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:45.138761 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9378881b-653a-4f18-b4c6-129aba3b8299 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:45.139675 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9378881b-653a-4f18-b4c6-129aba3b8299 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:45.140859 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9378881b-653a-4f18-b4c6-129aba3b8299 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:45.141625 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9378881b-653a-4f18-b4c6-129aba3b8299 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:45.177770 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-2440e2cc-fc00-4e50-b570-28f6423a2130 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Getting quotas for project 1d89deaaefc541739f67ab1e53c4bda3. Resources: {'ram', 'cores', 'instances'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:39:45.204322 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-2440e2cc-fc00-4e50-b570-28f6423a2130 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Getting quotas for user b191f41e53064acbaf17e3da073e7c85 and project 1d89deaaefc541739f67ab1e53c4bda3. Resources: {'ram', 'cores', 'instances'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:39:45.224863 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-2440e2cc-fc00-4e50-b570-28f6423a2130 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Going to run 1 instances... {{(pid=134666) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 13:39:45.227746 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-2440e2cc-fc00-4e50-b570-28f6423a2130 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7aacbf-3b3e-496e-967e-53d2a1b1f200',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 13:39:45.318656 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-2440e2cc-fc00-4e50-b570-28f6423a2130 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.347149 Jun 23 13:39:45.322893 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 22/55] 10.222.0.26 () {62 vars in 1187 bytes} [Thu Jun 23 13:39:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 3352 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 23 13:39:45.336704 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-5a2689b9-0395-4276-92eb-a290c39ce81b tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:45.338416 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-5a2689b9-0395-4276-92eb-a290c39ce81b tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:45.347512 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5a2689b9-0395-4276-92eb-a290c39ce81b tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:45.348200 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5a2689b9-0395-4276-92eb-a290c39ce81b tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:45.349782 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5a2689b9-0395-4276-92eb-a290c39ce81b tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:45.350391 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5a2689b9-0395-4276-92eb-a290c39ce81b tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:45.554858 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-5a2689b9-0395-4276-92eb-a290c39ce81b tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:45.572229 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-5a2689b9-0395-4276-92eb-a290c39ce81b tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1272 microversion: 2.1 time: 0.246990 Jun 23 13:39:45.572951 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 23/56] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:45 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1272 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:45.590559 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-e65973d5-a7f1-4e42-8a2a-532f245f3919 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:45.591445 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-e65973d5-a7f1-4e42-8a2a-532f245f3919 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:45.777194 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-e65973d5-a7f1-4e42-8a2a-532f245f3919 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:45.786108 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-e65973d5-a7f1-4e42-8a2a-532f245f3919 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:45.792419 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-e65973d5-a7f1-4e42-8a2a-532f245f3919 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:45.793502 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-e65973d5-a7f1-4e42-8a2a-532f245f3919 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1281 microversion: 2.20 time: 0.219533 Jun 23 13:39:45.794102 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 24/57] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:39:45 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1281 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:39:45.847605 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-9378881b-653a-4f18-b4c6-129aba3b8299 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:45.861603 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-9378881b-653a-4f18-b4c6-129aba3b8299 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa" status: 200 len: 1367 microversion: 2.1 time: 0.786333 Jun 23 13:39:45.864296 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 34/58] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:45 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa => generated 1367 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:46.113912 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-029ce9f4-167d-4433-a5e6-405e3336fe60 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:46.115453 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-029ce9f4-167d-4433-a5e6-405e3336fe60 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:46.136676 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-029ce9f4-167d-4433-a5e6-405e3336fe60 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:46.138596 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-029ce9f4-167d-4433-a5e6-405e3336fe60 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:46.141659 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-029ce9f4-167d-4433-a5e6-405e3336fe60 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:46.142599 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-029ce9f4-167d-4433-a5e6-405e3336fe60 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:46.590472 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-06bf6734-ded1-4c85-8eb7-91b99fd08a4e tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:46.591816 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-06bf6734-ded1-4c85-8eb7-91b99fd08a4e tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:46.599449 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-06bf6734-ded1-4c85-8eb7-91b99fd08a4e tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:46.600188 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-06bf6734-ded1-4c85-8eb7-91b99fd08a4e tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:46.601191 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-06bf6734-ded1-4c85-8eb7-91b99fd08a4e tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:46.601896 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-06bf6734-ded1-4c85-8eb7-91b99fd08a4e tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:46.810375 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-029ce9f4-167d-4433-a5e6-405e3336fe60 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:46.830171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-029ce9f4-167d-4433-a5e6-405e3336fe60 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1322 microversion: 2.1 time: 0.741403 Jun 23 13:39:46.831216 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 25/59] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:46 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1322 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:46.848522 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-9eb80c73-ebf8-47c9-bebe-1f7b563753c4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:46.849946 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-9eb80c73-ebf8-47c9-bebe-1f7b563753c4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:46.901750 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9eb80c73-ebf8-47c9-bebe-1f7b563753c4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:46.903008 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9eb80c73-ebf8-47c9-bebe-1f7b563753c4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:46.904225 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9eb80c73-ebf8-47c9-bebe-1f7b563753c4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:46.909260 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9eb80c73-ebf8-47c9-bebe-1f7b563753c4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:47.044877 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-06bf6734-ded1-4c85-8eb7-91b99fd08a4e tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:47.061396 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-06bf6734-ded1-4c85-8eb7-91b99fd08a4e tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1314 microversion: 2.1 time: 0.475783 Jun 23 13:39:47.062374 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 35/60] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:46 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:39:47.085709 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-bf9742fe-3e88-44db-b069-20b8f7b8dce4 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:47.092047 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-bf9742fe-3e88-44db-b069-20b8f7b8dce4 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:47.124076 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bf9742fe-3e88-44db-b069-20b8f7b8dce4 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:47.124821 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bf9742fe-3e88-44db-b069-20b8f7b8dce4 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:47.125800 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bf9742fe-3e88-44db-b069-20b8f7b8dce4 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:47.126434 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bf9742fe-3e88-44db-b069-20b8f7b8dce4 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:47.195650 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-9eb80c73-ebf8-47c9-bebe-1f7b563753c4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:47.215749 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-9eb80c73-ebf8-47c9-bebe-1f7b563753c4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:47.223455 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-9eb80c73-ebf8-47c9-bebe-1f7b563753c4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:47.229620 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-9eb80c73-ebf8-47c9-bebe-1f7b563753c4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1277 microversion: 2.20 time: 0.392943 Jun 23 13:39:47.233927 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 26/61] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:39:46 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1277 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:39:47.527863 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-bf9742fe-3e88-44db-b069-20b8f7b8dce4 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:47.540540 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-bf9742fe-3e88-44db-b069-20b8f7b8dce4 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa" status: 200 len: 1367 microversion: 2.1 time: 0.467152 Jun 23 13:39:47.546333 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 36/62] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:47 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa => generated 1367 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:47.850747 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-38913153-5d49-4fa2-a759-c0ce7e14f174 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:47.853021 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-38913153-5d49-4fa2-a759-c0ce7e14f174 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:47.863906 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell0:SELECT=4 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:47.880488 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-38913153-5d49-4fa2-a759-c0ce7e14f174 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:47.883691 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-38913153-5d49-4fa2-a759-c0ce7e14f174 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:47.885582 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-38913153-5d49-4fa2-a759-c0ce7e14f174 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:47.886052 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-38913153-5d49-4fa2-a759-c0ce7e14f174 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:48.098233 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-58b12556-d0bb-4157-9a59-2515181706ed req-9bf63c27-5c5b-4b18-85ac-bf0fccc901f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee2cdaf7-cefe-4877-b855-b4646b50cf29", "tag": "fff37344-1345-4e9c-9d02-4e0e47f479fc"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:39:48.142676 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-58b12556-d0bb-4157-9a59-2515181706ed req-9bf63c27-5c5b-4b18-85ac-bf0fccc901f1 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:48.143137 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-58b12556-d0bb-4157-9a59-2515181706ed req-9bf63c27-5c5b-4b18-85ac-bf0fccc901f1 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:48.259029 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-58b12556-d0bb-4157-9a59-2515181706ed req-9bf63c27-5c5b-4b18-85ac-bf0fccc901f1 service nova] Creating event network-changed:fff37344-1345-4e9c-9d02-4e0e47f479fc for instance ee2cdaf7-cefe-4877-b855-b4646b50cf29 on hv-cinder-81558 Jun 23 13:39:48.264364 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-58b12556-d0bb-4157-9a59-2515181706ed req-9bf63c27-5c5b-4b18-85ac-bf0fccc901f1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=134666) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 23 13:39:48.274630 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0a82e135-4f0c-414d-bbe5-99364eec3fa4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:48.274630 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0a82e135-4f0c-414d-bbe5-99364eec3fa4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:48.274630 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0a82e135-4f0c-414d-bbe5-99364eec3fa4 None None] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:48.281796 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0a82e135-4f0c-414d-bbe5-99364eec3fa4 None None] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:48.363158 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.compute.rpcapi [None req-0a82e135-4f0c-414d-bbe5-99364eec3fa4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 23 13:39:48.373909 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0a82e135-4f0c-414d-bbe5-99364eec3fa4 None None] Releasing lock "compute-rpcapi-router" {{(pid=134666) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 23 13:39:48.446456 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-38913153-5d49-4fa2-a759-c0ce7e14f174 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:48.462185 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-38913153-5d49-4fa2-a759-c0ce7e14f174 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1322 microversion: 2.1 time: 0.616734 Jun 23 13:39:48.466680 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-0a82e135-4f0c-414d-bbe5-99364eec3fa4 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.663467 Jun 23 13:39:48.469176 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 27/63] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:39:48.478317 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 37/64] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:47 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1322 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:48.479582 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-44854121-4955-4611-a535-824dc7d59a6e tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:48.484485 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-44854121-4955-4611-a535-824dc7d59a6e tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:48.505986 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-25596cc7-1d94-42dc-9085-9c9a60fb674f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:48.506805 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-25596cc7-1d94-42dc-9085-9c9a60fb674f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:48.512466 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-44854121-4955-4611-a535-824dc7d59a6e tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:48.515142 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-44854121-4955-4611-a535-824dc7d59a6e tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:48.517278 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-44854121-4955-4611-a535-824dc7d59a6e tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:48.518118 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-44854121-4955-4611-a535-824dc7d59a6e tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:48.532757 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-25596cc7-1d94-42dc-9085-9c9a60fb674f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:48.533221 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-25596cc7-1d94-42dc-9085-9c9a60fb674f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:48.538841 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-25596cc7-1d94-42dc-9085-9c9a60fb674f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:48.540936 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-25596cc7-1d94-42dc-9085-9c9a60fb674f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:48.766966 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-25596cc7-1d94-42dc-9085-9c9a60fb674f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:48.788776 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-25596cc7-1d94-42dc-9085-9c9a60fb674f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:48.796574 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-25596cc7-1d94-42dc-9085-9c9a60fb674f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:48.802905 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-25596cc7-1d94-42dc-9085-9c9a60fb674f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1333 microversion: 2.20 time: 0.320004 Jun 23 13:39:48.804884 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 38/65] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:39:48 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1333 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:39:48.827879 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-3a565240-0941-4ccc-8d9e-2ceeee8a109a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:48.830039 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-3a565240-0941-4ccc-8d9e-2ceeee8a109a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:48.848508 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3a565240-0941-4ccc-8d9e-2ceeee8a109a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:48.850127 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3a565240-0941-4ccc-8d9e-2ceeee8a109a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:48.853269 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3a565240-0941-4ccc-8d9e-2ceeee8a109a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:48.854955 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3a565240-0941-4ccc-8d9e-2ceeee8a109a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:49.307128 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell0:SELECT=16 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:49.356911 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-44854121-4955-4611-a535-824dc7d59a6e tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:49.377467 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-44854121-4955-4611-a535-824dc7d59a6e tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1314 microversion: 2.1 time: 0.905575 Jun 23 13:39:49.379217 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 28/66] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:48 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1314 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:49.482496 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-2fc96c80-7136-4673-a2e9-4e60f78d748f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:49.483780 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-2fc96c80-7136-4673-a2e9-4e60f78d748f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:49.521795 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2fc96c80-7136-4673-a2e9-4e60f78d748f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:49.527657 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2fc96c80-7136-4673-a2e9-4e60f78d748f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:49.534363 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2fc96c80-7136-4673-a2e9-4e60f78d748f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:49.537979 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2fc96c80-7136-4673-a2e9-4e60f78d748f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:50.667726 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-3a565240-0941-4ccc-8d9e-2ceeee8a109a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:50.682051 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-3a565240-0941-4ccc-8d9e-2ceeee8a109a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa" status: 200 len: 1367 microversion: 2.1 time: 1.874022 Jun 23 13:39:50.692562 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 39/67] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:48 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa => generated 1367 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:50.703497 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-4ddb4266-69b3-459f-b3e3-6026066b7340 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:50.703497 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-4ddb4266-69b3-459f-b3e3-6026066b7340 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:50.709147 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4ddb4266-69b3-459f-b3e3-6026066b7340 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:50.709852 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4ddb4266-69b3-459f-b3e3-6026066b7340 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:50.710833 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4ddb4266-69b3-459f-b3e3-6026066b7340 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:50.711741 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4ddb4266-69b3-459f-b3e3-6026066b7340 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:50.878397 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-4ddb4266-69b3-459f-b3e3-6026066b7340 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:50.890294 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-4ddb4266-69b3-459f-b3e3-6026066b7340 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:50.891828 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-4ddb4266-69b3-459f-b3e3-6026066b7340 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:50.892956 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-4ddb4266-69b3-459f-b3e3-6026066b7340 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1339 microversion: 2.20 time: 0.209285 Jun 23 13:39:50.893517 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 40/68] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:39:50 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1339 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:39:50.909765 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-2f8fab8f-a7d3-4832-a8b2-6f2ccbf26fa1 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:50.910384 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-2f8fab8f-a7d3-4832-a8b2-6f2ccbf26fa1 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:50.937419 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2f8fab8f-a7d3-4832-a8b2-6f2ccbf26fa1 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:50.937892 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2f8fab8f-a7d3-4832-a8b2-6f2ccbf26fa1 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:50.938703 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2f8fab8f-a7d3-4832-a8b2-6f2ccbf26fa1 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:50.939140 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2f8fab8f-a7d3-4832-a8b2-6f2ccbf26fa1 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:50.977227 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-2fc96c80-7136-4673-a2e9-4e60f78d748f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:50.984817 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-2fc96c80-7136-4673-a2e9-4e60f78d748f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1322 microversion: 2.1 time: 1.508644 Jun 23 13:39:50.988112 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 29/69] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:49 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1322 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:51.247500 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-104ca3cf-d88e-4022-b0cb-4294251f019c req-79ea0c7e-5cbf-4308-9f6b-7f97d19ad017 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a45e219e-e492-44d7-a962-1a741b0abcaa", "tag": "a620a38f-71e7-45a8-b6c8-6d3333e3b7a7"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:39:51.265102 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-104ca3cf-d88e-4022-b0cb-4294251f019c req-79ea0c7e-5cbf-4308-9f6b-7f97d19ad017 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:51.265727 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-104ca3cf-d88e-4022-b0cb-4294251f019c req-79ea0c7e-5cbf-4308-9f6b-7f97d19ad017 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:51.294436 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-104ca3cf-d88e-4022-b0cb-4294251f019c req-79ea0c7e-5cbf-4308-9f6b-7f97d19ad017 service nova] Creating event network-changed:a620a38f-71e7-45a8-b6c8-6d3333e3b7a7 for instance a45e219e-e492-44d7-a962-1a741b0abcaa on hv-cinder-81558 Jun 23 13:39:51.303773 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-104ca3cf-d88e-4022-b0cb-4294251f019c req-79ea0c7e-5cbf-4308-9f6b-7f97d19ad017 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.314024 Jun 23 13:39:51.305701 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 30/70] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:39:51.341144 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-2f8fab8f-a7d3-4832-a8b2-6f2ccbf26fa1 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:51.353882 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-2f8fab8f-a7d3-4832-a8b2-6f2ccbf26fa1 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1314 microversion: 2.1 time: 0.455701 Jun 23 13:39:51.354732 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 41/71] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:50 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:51.701291 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-5ab55a76-9c9c-4fc4-ae40-c1a18b4b4f4e tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:51.702242 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-5ab55a76-9c9c-4fc4-ae40-c1a18b4b4f4e tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:51.711713 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5ab55a76-9c9c-4fc4-ae40-c1a18b4b4f4e tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:51.713186 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5ab55a76-9c9c-4fc4-ae40-c1a18b4b4f4e tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:51.715215 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5ab55a76-9c9c-4fc4-ae40-c1a18b4b4f4e tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:51.720123 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5ab55a76-9c9c-4fc4-ae40-c1a18b4b4f4e tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:51.919782 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-38aac167-4067-473a-8e46-a4adf246ff67 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:51.928067 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-38aac167-4067-473a-8e46-a4adf246ff67 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:51.954760 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-38aac167-4067-473a-8e46-a4adf246ff67 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:51.961375 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-38aac167-4067-473a-8e46-a4adf246ff67 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:51.968299 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-38aac167-4067-473a-8e46-a4adf246ff67 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:51.970994 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-38aac167-4067-473a-8e46-a4adf246ff67 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:52.172190 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-38aac167-4067-473a-8e46-a4adf246ff67 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:52.176115 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-5ab55a76-9c9c-4fc4-ae40-c1a18b4b4f4e tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:52.192528 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-38aac167-4067-473a-8e46-a4adf246ff67 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:52.193403 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-5ab55a76-9c9c-4fc4-ae40-c1a18b4b4f4e tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa" status: 200 len: 1367 microversion: 2.1 time: 0.497550 Jun 23 13:39:52.194765 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-38aac167-4067-473a-8e46-a4adf246ff67 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:52.197214 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-38aac167-4067-473a-8e46-a4adf246ff67 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1339 microversion: 2.20 time: 0.289315 Jun 23 13:39:52.198094 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 42/72] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:39:51 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1339 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:39:52.204087 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 31/73] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:51 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa => generated 1367 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:52.206109 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-b53012f8-d28a-4145-9ca4-acaf9a42d1df tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:52.208861 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-b53012f8-d28a-4145-9ca4-acaf9a42d1df tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:52.216940 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b53012f8-d28a-4145-9ca4-acaf9a42d1df tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:52.219949 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b53012f8-d28a-4145-9ca4-acaf9a42d1df tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:52.226677 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b53012f8-d28a-4145-9ca4-acaf9a42d1df tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:52.227371 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b53012f8-d28a-4145-9ca4-acaf9a42d1df tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:52.373530 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-951aa539-9439-4e84-a277-6eb1ca47eea4 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:52.374622 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-951aa539-9439-4e84-a277-6eb1ca47eea4 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:52.387545 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-951aa539-9439-4e84-a277-6eb1ca47eea4 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:52.391312 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-951aa539-9439-4e84-a277-6eb1ca47eea4 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:52.393680 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-951aa539-9439-4e84-a277-6eb1ca47eea4 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:52.395701 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-951aa539-9439-4e84-a277-6eb1ca47eea4 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:52.433576 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-b53012f8-d28a-4145-9ca4-acaf9a42d1df tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:52.452676 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-b53012f8-d28a-4145-9ca4-acaf9a42d1df tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1322 microversion: 2.1 time: 0.253324 Jun 23 13:39:52.455125 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 43/74] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:52 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:52.610420 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-951aa539-9439-4e84-a277-6eb1ca47eea4 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:52.621520 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-951aa539-9439-4e84-a277-6eb1ca47eea4 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1314 microversion: 2.1 time: 0.253432 Jun 23 13:39:52.623619 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 32/75] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:52 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:53.214048 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-4d78e8b2-6644-4126-845e-9a1781a80ad3 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:53.214048 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-4d78e8b2-6644-4126-845e-9a1781a80ad3 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:53.225977 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-7d65147e-60da-41c7-951f-1db01421430d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:53.227200 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-7d65147e-60da-41c7-951f-1db01421430d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:53.234343 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4d78e8b2-6644-4126-845e-9a1781a80ad3 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:53.236037 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4d78e8b2-6644-4126-845e-9a1781a80ad3 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:53.238087 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4d78e8b2-6644-4126-845e-9a1781a80ad3 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:53.239058 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=10 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:53.239715 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4d78e8b2-6644-4126-845e-9a1781a80ad3 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:53.243708 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7d65147e-60da-41c7-951f-1db01421430d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:53.244790 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7d65147e-60da-41c7-951f-1db01421430d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:53.248064 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7d65147e-60da-41c7-951f-1db01421430d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:53.248907 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7d65147e-60da-41c7-951f-1db01421430d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:53.509396 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-4d78e8b2-6644-4126-845e-9a1781a80ad3 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:53.513593 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-7d65147e-60da-41c7-951f-1db01421430d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:53.514280 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=100 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:53.522949 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-4d78e8b2-6644-4126-845e-9a1781a80ad3 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa" status: 200 len: 1367 microversion: 2.1 time: 0.316212 Jun 23 13:39:53.523988 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-7d65147e-60da-41c7-951f-1db01421430d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:53.525549 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-7d65147e-60da-41c7-951f-1db01421430d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:53.526147 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 44/76] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:53 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa => generated 1367 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:53.536062 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-7d65147e-60da-41c7-951f-1db01421430d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1406 microversion: 2.20 time: 0.315849 Jun 23 13:39:53.536929 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 33/77] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:39:53 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1406 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:39:53.542961 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-6e2d77ca-2c7d-489e-8379-d1daf08918cf tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:53.544083 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-09c243d7-330e-4b8a-b383-67b7ad61cff4 req-452713cb-8b55-417c-8f08-6240af0e98e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8dd165f-4996-4336-a117-cd2a9ba751fa", "tag": "b21a6caf-efbc-4abd-ac6f-b37cb3962be9"}, {"name": "network-changed", "server_uuid": "8e1bdfeb-cac1-45d2-9708-ac7386c20fe4", "tag": "5c5684f2-ed9c-4909-9cad-02bd2b76d63d"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:39:53.550007 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-6e2d77ca-2c7d-489e-8379-d1daf08918cf tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:53.564483 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6e2d77ca-2c7d-489e-8379-d1daf08918cf tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:53.564938 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6e2d77ca-2c7d-489e-8379-d1daf08918cf tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:53.565719 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6e2d77ca-2c7d-489e-8379-d1daf08918cf tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:53.566325 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6e2d77ca-2c7d-489e-8379-d1daf08918cf tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:53.569907 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-09c243d7-330e-4b8a-b383-67b7ad61cff4 req-452713cb-8b55-417c-8f08-6240af0e98e4 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:53.570738 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-09c243d7-330e-4b8a-b383-67b7ad61cff4 req-452713cb-8b55-417c-8f08-6240af0e98e4 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:53.613248 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-09c243d7-330e-4b8a-b383-67b7ad61cff4 req-452713cb-8b55-417c-8f08-6240af0e98e4 service nova] Creating event network-changed:b21a6caf-efbc-4abd-ac6f-b37cb3962be9 for instance f8dd165f-4996-4336-a117-cd2a9ba751fa on hv-cinder-81558 Jun 23 13:39:53.614049 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-09c243d7-330e-4b8a-b383-67b7ad61cff4 req-452713cb-8b55-417c-8f08-6240af0e98e4 service nova] Creating event network-changed:5c5684f2-ed9c-4909-9cad-02bd2b76d63d for instance 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 on hv-cinder-81558 Jun 23 13:39:53.614817 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-09c243d7-330e-4b8a-b383-67b7ad61cff4 req-452713cb-8b55-417c-8f08-6240af0e98e4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=134667) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 23 13:39:53.615938 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2092d28f-92d1-4f3e-830e-8acf1286a98b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:53.616540 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2092d28f-92d1-4f3e-830e-8acf1286a98b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:53.617480 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2092d28f-92d1-4f3e-830e-8acf1286a98b None None] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:53.618053 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2092d28f-92d1-4f3e-830e-8acf1286a98b None None] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:53.655701 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.compute.rpcapi [None req-2092d28f-92d1-4f3e-830e-8acf1286a98b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 23 13:39:53.657421 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2092d28f-92d1-4f3e-830e-8acf1286a98b None None] Releasing lock "compute-rpcapi-router" {{(pid=134667) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 23 13:39:53.688731 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-2092d28f-92d1-4f3e-830e-8acf1286a98b None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.160820 Jun 23 13:39:53.689574 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 45/78] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:39:53.700104 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-6f44e821-6f89-437f-aac4-093474ac7d58 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:53.708937 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-6f44e821-6f89-437f-aac4-093474ac7d58 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:53.725447 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6f44e821-6f89-437f-aac4-093474ac7d58 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:53.725962 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6f44e821-6f89-437f-aac4-093474ac7d58 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:53.726759 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6f44e821-6f89-437f-aac4-093474ac7d58 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:53.727195 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6f44e821-6f89-437f-aac4-093474ac7d58 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:53.856365 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-6e2d77ca-2c7d-489e-8379-d1daf08918cf tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:53.870299 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-6e2d77ca-2c7d-489e-8379-d1daf08918cf tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1322 microversion: 2.1 time: 0.331979 Jun 23 13:39:53.871000 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 34/79] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:53 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1322 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:53.990342 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-6f44e821-6f89-437f-aac4-093474ac7d58 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:54.000063 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-6f44e821-6f89-437f-aac4-093474ac7d58 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1314 microversion: 2.1 time: 0.309080 Jun 23 13:39:54.000721 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 46/80] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:53 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:54.542876 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-4a0ceb69-4839-4898-a988-d65d46245168 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:54.545232 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-4a0ceb69-4839-4898-a988-d65d46245168 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:54.555162 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-0ec4e6c6-4db3-4a0f-a89b-5c21d920275e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:54.556750 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-0ec4e6c6-4db3-4a0f-a89b-5c21d920275e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:54.568499 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4a0ceb69-4839-4898-a988-d65d46245168 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:54.570163 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4a0ceb69-4839-4898-a988-d65d46245168 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:54.570587 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0ec4e6c6-4db3-4a0f-a89b-5c21d920275e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:54.571285 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0ec4e6c6-4db3-4a0f-a89b-5c21d920275e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:54.572226 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4a0ceb69-4839-4898-a988-d65d46245168 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:54.573259 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0ec4e6c6-4db3-4a0f-a89b-5c21d920275e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:54.574014 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4a0ceb69-4839-4898-a988-d65d46245168 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:54.575267 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0ec4e6c6-4db3-4a0f-a89b-5c21d920275e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:54.901649 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-4a0ceb69-4839-4898-a988-d65d46245168 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:54.910657 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-4a0ceb69-4839-4898-a988-d65d46245168 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa" status: 200 len: 1367 microversion: 2.1 time: 0.371764 Jun 23 13:39:54.915572 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 35/81] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:54 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa => generated 1367 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:39:54.923053 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-0ec4e6c6-4db3-4a0f-a89b-5c21d920275e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:54.925130 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-815c2510-5215-4ce7-9ebd-2c6daaba0d46 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:54.926132 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-815c2510-5215-4ce7-9ebd-2c6daaba0d46 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:54.933088 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-815c2510-5215-4ce7-9ebd-2c6daaba0d46 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:54.933771 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-815c2510-5215-4ce7-9ebd-2c6daaba0d46 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:54.934415 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-0ec4e6c6-4db3-4a0f-a89b-5c21d920275e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:54.934953 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-815c2510-5215-4ce7-9ebd-2c6daaba0d46 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:54.935708 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-815c2510-5215-4ce7-9ebd-2c6daaba0d46 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:54.938563 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-0ec4e6c6-4db3-4a0f-a89b-5c21d920275e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:54.941615 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-0ec4e6c6-4db3-4a0f-a89b-5c21d920275e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1406 microversion: 2.20 time: 0.390726 Jun 23 13:39:54.943766 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 47/82] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:39:54 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1406 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 13:39:55.017455 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-22491ca6-d86a-4888-bdcf-005527a7bb2c tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:55.018172 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-22491ca6-d86a-4888-bdcf-005527a7bb2c tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:55.028615 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-22491ca6-d86a-4888-bdcf-005527a7bb2c tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:55.029150 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-22491ca6-d86a-4888-bdcf-005527a7bb2c tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:55.030257 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-22491ca6-d86a-4888-bdcf-005527a7bb2c tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:55.031041 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-22491ca6-d86a-4888-bdcf-005527a7bb2c tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:55.156792 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-815c2510-5215-4ce7-9ebd-2c6daaba0d46 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:55.169503 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-815c2510-5215-4ce7-9ebd-2c6daaba0d46 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1322 microversion: 2.1 time: 0.251250 Jun 23 13:39:55.180083 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 36/83] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:54 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:55.303934 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-22491ca6-d86a-4888-bdcf-005527a7bb2c tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:55.313175 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-22491ca6-d86a-4888-bdcf-005527a7bb2c tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1314 microversion: 2.1 time: 0.299712 Jun 23 13:39:55.314373 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 48/84] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:55 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:39:55.722872 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-8b14737e-bc70-410a-8454-7d6cd4f986a8 req-9c2e669b-0afc-4d20-ab58-b057df016b2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9ddb941-db20-4a0c-b841-d99368ad4f21", "tag": "07687dd4-8eaf-46e2-8bcb-86dc90291b87"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:39:55.749665 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-8b14737e-bc70-410a-8454-7d6cd4f986a8 req-9c2e669b-0afc-4d20-ab58-b057df016b2a service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:55.751373 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-8b14737e-bc70-410a-8454-7d6cd4f986a8 req-9c2e669b-0afc-4d20-ab58-b057df016b2a service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:55.780248 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-8b14737e-bc70-410a-8454-7d6cd4f986a8 req-9c2e669b-0afc-4d20-ab58-b057df016b2a service nova] Creating event network-changed:07687dd4-8eaf-46e2-8bcb-86dc90291b87 for instance b9ddb941-db20-4a0c-b841-d99368ad4f21 on hv-cinder-81558 Jun 23 13:39:55.799945 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-8b14737e-bc70-410a-8454-7d6cd4f986a8 req-9c2e669b-0afc-4d20-ab58-b057df016b2a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082077 Jun 23 13:39:55.802220 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 37/85] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:39:55.933264 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-9d6b16d0-08ad-4e4b-b71b-5abb661f496f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:55.934491 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-9d6b16d0-08ad-4e4b-b71b-5abb661f496f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:55.942851 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9d6b16d0-08ad-4e4b-b71b-5abb661f496f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:55.943488 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9d6b16d0-08ad-4e4b-b71b-5abb661f496f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:55.944433 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9d6b16d0-08ad-4e4b-b71b-5abb661f496f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:55.945174 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9d6b16d0-08ad-4e4b-b71b-5abb661f496f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:55.959300 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-9bc96c46-e528-45df-b5d7-3b2077374440 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:55.960198 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-9bc96c46-e528-45df-b5d7-3b2077374440 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:55.963076 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell0:SELECT=28 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:55.987543 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9bc96c46-e528-45df-b5d7-3b2077374440 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:55.988231 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9bc96c46-e528-45df-b5d7-3b2077374440 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:55.989160 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9bc96c46-e528-45df-b5d7-3b2077374440 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:55.989769 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9bc96c46-e528-45df-b5d7-3b2077374440 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:56.267597 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-9bc96c46-e528-45df-b5d7-3b2077374440 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:56.271257 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-9d6b16d0-08ad-4e4b-b71b-5abb661f496f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:56.287008 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-9d6b16d0-08ad-4e4b-b71b-5abb661f496f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa" status: 200 len: 1367 microversion: 2.1 time: 0.357998 Jun 23 13:39:56.294984 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 49/86] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:55 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa => generated 1367 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:56.308800 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-d95096eb-1dce-4791-af4b-42416c9efce0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:56.309840 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-d95096eb-1dce-4791-af4b-42416c9efce0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:56.310771 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-9bc96c46-e528-45df-b5d7-3b2077374440 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:56.318188 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-9bc96c46-e528-45df-b5d7-3b2077374440 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:56.319778 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-9bc96c46-e528-45df-b5d7-3b2077374440 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1406 microversion: 2.20 time: 0.365423 Jun 23 13:39:56.320371 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d95096eb-1dce-4791-af4b-42416c9efce0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:56.320972 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d95096eb-1dce-4791-af4b-42416c9efce0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:56.321149 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 38/87] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:39:55 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1406 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 13:39:56.321990 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d95096eb-1dce-4791-af4b-42416c9efce0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:56.323808 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d95096eb-1dce-4791-af4b-42416c9efce0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:56.332239 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-24472c39-1761-44a5-8683-d4e9762f3883 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:56.337147 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-24472c39-1761-44a5-8683-d4e9762f3883 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:56.352642 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-24472c39-1761-44a5-8683-d4e9762f3883 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:56.353528 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-24472c39-1761-44a5-8683-d4e9762f3883 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:56.354735 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-24472c39-1761-44a5-8683-d4e9762f3883 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:56.355763 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-24472c39-1761-44a5-8683-d4e9762f3883 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:56.365624 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:SELECT=100 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:56.602512 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-d95096eb-1dce-4791-af4b-42416c9efce0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:56.611320 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-d95096eb-1dce-4791-af4b-42416c9efce0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1322 microversion: 2.1 time: 0.313716 Jun 23 13:39:56.614915 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 50/88] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:56 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:56.652869 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-24472c39-1761-44a5-8683-d4e9762f3883 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:56.661709 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-24472c39-1761-44a5-8683-d4e9762f3883 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1314 microversion: 2.1 time: 0.334908 Jun 23 13:39:56.663066 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 39/89] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:56 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:57.322699 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-530fa768-7f2d-4a45-a4ff-8b888f093c17 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:57.323397 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-530fa768-7f2d-4a45-a4ff-8b888f093c17 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:57.332561 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-530fa768-7f2d-4a45-a4ff-8b888f093c17 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:57.338630 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-99c2f8c3-6ffb-4db3-9372-1d139a2c9a40 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:57.339831 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-99c2f8c3-6ffb-4db3-9372-1d139a2c9a40 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:57.349820 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-99c2f8c3-6ffb-4db3-9372-1d139a2c9a40 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:57.350286 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-99c2f8c3-6ffb-4db3-9372-1d139a2c9a40 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:57.351055 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-99c2f8c3-6ffb-4db3-9372-1d139a2c9a40 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:57.351508 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-530fa768-7f2d-4a45-a4ff-8b888f093c17 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:57.352679 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-530fa768-7f2d-4a45-a4ff-8b888f093c17 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:57.353875 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-530fa768-7f2d-4a45-a4ff-8b888f093c17 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:57.359354 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-99c2f8c3-6ffb-4db3-9372-1d139a2c9a40 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:57.757590 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-99c2f8c3-6ffb-4db3-9372-1d139a2c9a40 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:57.772203 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-99c2f8c3-6ffb-4db3-9372-1d139a2c9a40 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:57.777004 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-99c2f8c3-6ffb-4db3-9372-1d139a2c9a40 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:57.778616 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-99c2f8c3-6ffb-4db3-9372-1d139a2c9a40 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1406 microversion: 2.20 time: 0.443956 Jun 23 13:39:57.792064 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 40/90] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:39:57 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1406 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:39:57.804032 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-ce318fe8-3c67-4124-91ee-81229612d940 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:57.804727 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-ce318fe8-3c67-4124-91ee-81229612d940 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:57.817357 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ce318fe8-3c67-4124-91ee-81229612d940 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:57.819654 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ce318fe8-3c67-4124-91ee-81229612d940 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:57.820703 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ce318fe8-3c67-4124-91ee-81229612d940 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:57.821776 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ce318fe8-3c67-4124-91ee-81229612d940 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:57.842828 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-530fa768-7f2d-4a45-a4ff-8b888f093c17 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:57.857484 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-530fa768-7f2d-4a45-a4ff-8b888f093c17 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa" status: 200 len: 1367 microversion: 2.1 time: 0.540024 Jun 23 13:39:57.858740 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 51/91] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:57 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa => generated 1367 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:57.864005 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-9c4f719b-09ce-463a-9cb1-382c66d31179 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:57.870726 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-9c4f719b-09ce-463a-9cb1-382c66d31179 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:57.878861 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9c4f719b-09ce-463a-9cb1-382c66d31179 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:57.882761 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9c4f719b-09ce-463a-9cb1-382c66d31179 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:57.883793 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9c4f719b-09ce-463a-9cb1-382c66d31179 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:57.884369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9c4f719b-09ce-463a-9cb1-382c66d31179 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:58.319005 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell0:SELECT=8 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:39:58.353690 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-ce318fe8-3c67-4124-91ee-81229612d940 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:58.363038 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-ce318fe8-3c67-4124-91ee-81229612d940 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1322 microversion: 2.1 time: 0.568611 Jun 23 13:39:58.364163 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 41/92] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:57 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1322 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:58.620492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-af6d0d89-fb2d-4f5d-9f5b-4184b572da55 req-161886e2-9c20-44eb-91a7-61ba66320d79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee2cdaf7-cefe-4877-b855-b4646b50cf29", "name": "network-vif-plugged", "status": "completed", "tag": "fff37344-1345-4e9c-9d02-4e0e47f479fc"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:39:58.626400 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-9c4f719b-09ce-463a-9cb1-382c66d31179 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:58.638692 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-9c4f719b-09ce-463a-9cb1-382c66d31179 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1314 microversion: 2.1 time: 0.776098 Jun 23 13:39:58.644116 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-af6d0d89-fb2d-4f5d-9f5b-4184b572da55 req-161886e2-9c20-44eb-91a7-61ba66320d79 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:58.645054 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-af6d0d89-fb2d-4f5d-9f5b-4184b572da55 req-161886e2-9c20-44eb-91a7-61ba66320d79 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:58.655645 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 52/93] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:57 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1314 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:58.718268 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-af6d0d89-fb2d-4f5d-9f5b-4184b572da55 req-161886e2-9c20-44eb-91a7-61ba66320d79 service nova] Creating event network-vif-plugged:fff37344-1345-4e9c-9d02-4e0e47f479fc for instance ee2cdaf7-cefe-4877-b855-b4646b50cf29 on hv-cinder-81558 Jun 23 13:39:58.754936 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-af6d0d89-fb2d-4f5d-9f5b-4184b572da55 req-161886e2-9c20-44eb-91a7-61ba66320d79 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.380899 Jun 23 13:39:58.757970 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 42/94] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:39:58.799511 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-3110a8f2-f8bc-4412-a338-494404b04205 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:58.800511 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-3110a8f2-f8bc-4412-a338-494404b04205 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:58.815602 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3110a8f2-f8bc-4412-a338-494404b04205 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:58.818197 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3110a8f2-f8bc-4412-a338-494404b04205 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:58.821133 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3110a8f2-f8bc-4412-a338-494404b04205 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:58.822271 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3110a8f2-f8bc-4412-a338-494404b04205 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:58.880501 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-8bbab64a-39c3-4c9f-b496-01786d650140 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:58.881216 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-8bbab64a-39c3-4c9f-b496-01786d650140 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:58.893999 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8bbab64a-39c3-4c9f-b496-01786d650140 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:58.894452 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8bbab64a-39c3-4c9f-b496-01786d650140 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:58.899065 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8bbab64a-39c3-4c9f-b496-01786d650140 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:58.900615 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8bbab64a-39c3-4c9f-b496-01786d650140 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:59.244609 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-8bbab64a-39c3-4c9f-b496-01786d650140 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:59.255190 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-3110a8f2-f8bc-4412-a338-494404b04205 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:59.257927 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-8bbab64a-39c3-4c9f-b496-01786d650140 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa" status: 200 len: 1367 microversion: 2.1 time: 0.383095 Jun 23 13:39:59.260425 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 43/95] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:58 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa => generated 1367 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:39:59.265552 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-3110a8f2-f8bc-4412-a338-494404b04205 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:59.268146 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-3110a8f2-f8bc-4412-a338-494404b04205 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:59.270436 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-3110a8f2-f8bc-4412-a338-494404b04205 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1406 microversion: 2.20 time: 0.476279 Jun 23 13:39:59.299511 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 53/96] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:39:58 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1406 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:39:59.381254 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-20043235-a1e8-4c74-8539-af891af76d01 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:59.382516 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-20043235-a1e8-4c74-8539-af891af76d01 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:59.395404 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-20043235-a1e8-4c74-8539-af891af76d01 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:59.396173 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-20043235-a1e8-4c74-8539-af891af76d01 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:59.402321 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-20043235-a1e8-4c74-8539-af891af76d01 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:59.403121 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-20043235-a1e8-4c74-8539-af891af76d01 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:59.664793 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-82bb21ad-bc83-4b32-96b2-1888a9100ad3 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:39:59.666494 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-82bb21ad-bc83-4b32-96b2-1888a9100ad3 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:39:59.677805 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-82bb21ad-bc83-4b32-96b2-1888a9100ad3 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:59.678709 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-82bb21ad-bc83-4b32-96b2-1888a9100ad3 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:59.679798 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-82bb21ad-bc83-4b32-96b2-1888a9100ad3 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:39:59.680668 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-82bb21ad-bc83-4b32-96b2-1888a9100ad3 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:39:59.772093 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-20043235-a1e8-4c74-8539-af891af76d01 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:39:59.798916 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-20043235-a1e8-4c74-8539-af891af76d01 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1322 microversion: 2.1 time: 0.422028 Jun 23 13:39:59.800808 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 44/97] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:59 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1322 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:00.156344 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-82bb21ad-bc83-4b32-96b2-1888a9100ad3 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:00.165920 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-82bb21ad-bc83-4b32-96b2-1888a9100ad3 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1314 microversion: 2.1 time: 0.507266 Jun 23 13:40:00.175369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 54/98] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:39:59 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:40:00.279724 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-a78c034b-9648-4b3c-953d-096793dabd51 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:00.284780 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-a78c034b-9648-4b3c-953d-096793dabd51 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:00.290354 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-34617f7f-a8de-49c1-8922-2e21c890a581 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:00.291250 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-34617f7f-a8de-49c1-8922-2e21c890a581 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:00.292764 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a78c034b-9648-4b3c-953d-096793dabd51 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:00.293791 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a78c034b-9648-4b3c-953d-096793dabd51 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:00.295261 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a78c034b-9648-4b3c-953d-096793dabd51 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:00.295786 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a78c034b-9648-4b3c-953d-096793dabd51 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:00.301452 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-34617f7f-a8de-49c1-8922-2e21c890a581 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:00.302718 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-34617f7f-a8de-49c1-8922-2e21c890a581 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:00.304219 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-34617f7f-a8de-49c1-8922-2e21c890a581 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:00.305112 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-34617f7f-a8de-49c1-8922-2e21c890a581 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:00.545743 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-a78c034b-9648-4b3c-953d-096793dabd51 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:00.561081 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-a78c034b-9648-4b3c-953d-096793dabd51 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa" status: 200 len: 1367 microversion: 2.1 time: 0.288697 Jun 23 13:40:00.563422 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 45/99] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:00 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:00.651242 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-34617f7f-a8de-49c1-8922-2e21c890a581 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:00.666780 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-34617f7f-a8de-49c1-8922-2e21c890a581 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:00.672162 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-34617f7f-a8de-49c1-8922-2e21c890a581 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:00.676640 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-34617f7f-a8de-49c1-8922-2e21c890a581 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1406 microversion: 2.20 time: 0.390063 Jun 23 13:40:00.678553 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 55/100] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:40:00 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1406 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 13:40:00.781289 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-36dd287f-d889-42c1-9e1e-0114f710d1a0 req-80234807-445d-4fa7-82e0-3e3e6265416a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8dd165f-4996-4336-a117-cd2a9ba751fa", "name": "network-vif-plugged", "status": "completed", "tag": "b21a6caf-efbc-4abd-ac6f-b37cb3962be9"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:40:00.809234 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-36dd287f-d889-42c1-9e1e-0114f710d1a0 req-80234807-445d-4fa7-82e0-3e3e6265416a service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:00.809713 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-36dd287f-d889-42c1-9e1e-0114f710d1a0 req-80234807-445d-4fa7-82e0-3e3e6265416a service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:00.819106 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-31e4a140-bb50-441e-b7b4-a12598f6cf8f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:00.819909 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-31e4a140-bb50-441e-b7b4-a12598f6cf8f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:00.834380 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-31e4a140-bb50-441e-b7b4-a12598f6cf8f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:00.837337 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-31e4a140-bb50-441e-b7b4-a12598f6cf8f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:00.841837 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-31e4a140-bb50-441e-b7b4-a12598f6cf8f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:00.843614 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-31e4a140-bb50-441e-b7b4-a12598f6cf8f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:00.860841 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-36dd287f-d889-42c1-9e1e-0114f710d1a0 req-80234807-445d-4fa7-82e0-3e3e6265416a service nova] Creating event network-vif-plugged:b21a6caf-efbc-4abd-ac6f-b37cb3962be9 for instance f8dd165f-4996-4336-a117-cd2a9ba751fa on hv-cinder-81558 Jun 23 13:40:00.872343 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-36dd287f-d889-42c1-9e1e-0114f710d1a0 req-80234807-445d-4fa7-82e0-3e3e6265416a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096473 Jun 23 13:40:00.872949 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 46/101] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:40:01.133280 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-31e4a140-bb50-441e-b7b4-a12598f6cf8f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:01.144813 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-31e4a140-bb50-441e-b7b4-a12598f6cf8f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1322 microversion: 2.1 time: 0.330472 Jun 23 13:40:01.145406 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 56/102] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:00 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1322 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:01.194886 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-65a0c9b8-41ed-465b-988d-5fa1f16e824d tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:01.195867 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-65a0c9b8-41ed-465b-988d-5fa1f16e824d tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:01.203072 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-65a0c9b8-41ed-465b-988d-5fa1f16e824d tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:01.203753 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-65a0c9b8-41ed-465b-988d-5fa1f16e824d tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:01.204716 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-65a0c9b8-41ed-465b-988d-5fa1f16e824d tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:01.205638 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-65a0c9b8-41ed-465b-988d-5fa1f16e824d tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:01.355418 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-65a0c9b8-41ed-465b-988d-5fa1f16e824d tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:01.363512 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-65a0c9b8-41ed-465b-988d-5fa1f16e824d tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1314 microversion: 2.1 time: 0.174092 Jun 23 13:40:01.364095 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 47/103] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:01 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:01.578025 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-1673f104-2852-476e-a86e-ce6ec7e85e56 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:01.578639 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-1673f104-2852-476e-a86e-ce6ec7e85e56 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:01.585322 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1673f104-2852-476e-a86e-ce6ec7e85e56 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:01.585871 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1673f104-2852-476e-a86e-ce6ec7e85e56 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:01.587006 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1673f104-2852-476e-a86e-ce6ec7e85e56 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:01.587464 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1673f104-2852-476e-a86e-ce6ec7e85e56 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:01.694854 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-2a8d88d0-3aa4-4632-a719-4767bb58c6a6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:01.695850 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-2a8d88d0-3aa4-4632-a719-4767bb58c6a6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:01.701806 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2a8d88d0-3aa4-4632-a719-4767bb58c6a6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:01.702484 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2a8d88d0-3aa4-4632-a719-4767bb58c6a6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:01.703474 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2a8d88d0-3aa4-4632-a719-4767bb58c6a6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:01.704483 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2a8d88d0-3aa4-4632-a719-4767bb58c6a6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:01.803638 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-1673f104-2852-476e-a86e-ce6ec7e85e56 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:01.824040 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-1673f104-2852-476e-a86e-ce6ec7e85e56 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa" status: 200 len: 1367 microversion: 2.1 time: 0.248728 Jun 23 13:40:01.826102 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 57/104] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:01 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:01.883991 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-2a8d88d0-3aa4-4632-a719-4767bb58c6a6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:01.893174 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-2a8d88d0-3aa4-4632-a719-4767bb58c6a6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:01.894697 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-2a8d88d0-3aa4-4632-a719-4767bb58c6a6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:01.895857 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-2a8d88d0-3aa4-4632-a719-4767bb58c6a6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1406 microversion: 2.20 time: 0.205199 Jun 23 13:40:01.896415 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 48/105] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:40:01 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 13:40:02.165290 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-775b8088-a522-4c88-8d4e-afe3215f9880 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:02.165921 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-775b8088-a522-4c88-8d4e-afe3215f9880 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:02.182493 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-775b8088-a522-4c88-8d4e-afe3215f9880 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:02.183170 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-775b8088-a522-4c88-8d4e-afe3215f9880 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:02.184063 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-775b8088-a522-4c88-8d4e-afe3215f9880 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:02.184488 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-775b8088-a522-4c88-8d4e-afe3215f9880 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:02.340612 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-775b8088-a522-4c88-8d4e-afe3215f9880 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:02.348843 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-775b8088-a522-4c88-8d4e-afe3215f9880 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1322 microversion: 2.1 time: 0.190867 Jun 23 13:40:02.349927 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 58/106] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:02 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:02.380833 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-d61ccedd-5bdc-469b-8320-2444c0d11dad tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:02.381626 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-d61ccedd-5bdc-469b-8320-2444c0d11dad tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:02.388335 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d61ccedd-5bdc-469b-8320-2444c0d11dad tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:02.389001 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d61ccedd-5bdc-469b-8320-2444c0d11dad tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:02.389961 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d61ccedd-5bdc-469b-8320-2444c0d11dad tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:02.390566 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d61ccedd-5bdc-469b-8320-2444c0d11dad tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:02.554870 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-d61ccedd-5bdc-469b-8320-2444c0d11dad tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:02.562617 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-d61ccedd-5bdc-469b-8320-2444c0d11dad tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1314 microversion: 2.1 time: 0.186901 Jun 23 13:40:02.572120 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 49/107] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:02 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:02.842425 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-adfaae24-ab78-4d22-8c17-2a34a853d02f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:02.843065 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-adfaae24-ab78-4d22-8c17-2a34a853d02f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:02.849176 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-adfaae24-ab78-4d22-8c17-2a34a853d02f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:02.849844 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-adfaae24-ab78-4d22-8c17-2a34a853d02f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:02.850782 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-adfaae24-ab78-4d22-8c17-2a34a853d02f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:02.851412 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-adfaae24-ab78-4d22-8c17-2a34a853d02f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:02.914562 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-480e64f2-9058-4d5f-8260-4155ca4bd6fd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:02.915446 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-480e64f2-9058-4d5f-8260-4155ca4bd6fd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:02.921955 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-480e64f2-9058-4d5f-8260-4155ca4bd6fd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:02.929045 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-480e64f2-9058-4d5f-8260-4155ca4bd6fd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:02.929925 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-480e64f2-9058-4d5f-8260-4155ca4bd6fd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:02.930371 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-480e64f2-9058-4d5f-8260-4155ca4bd6fd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:03.130366 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-adfaae24-ab78-4d22-8c17-2a34a853d02f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:03.140975 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-adfaae24-ab78-4d22-8c17-2a34a853d02f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa" status: 200 len: 1367 microversion: 2.1 time: 0.302474 Jun 23 13:40:03.151889 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 59/108] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:02 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa => generated 1367 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:03.158895 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-480e64f2-9058-4d5f-8260-4155ca4bd6fd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:03.167902 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-480e64f2-9058-4d5f-8260-4155ca4bd6fd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:03.169639 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-480e64f2-9058-4d5f-8260-4155ca4bd6fd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:03.170772 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-480e64f2-9058-4d5f-8260-4155ca4bd6fd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1406 microversion: 2.20 time: 0.260701 Jun 23 13:40:03.171363 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 50/109] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:40:02 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1406 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 13:40:03.370602 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-c9bf41c4-a34b-43c8-a98d-9e170aabc47d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:03.371377 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-c9bf41c4-a34b-43c8-a98d-9e170aabc47d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:03.377785 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c9bf41c4-a34b-43c8-a98d-9e170aabc47d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:03.378240 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c9bf41c4-a34b-43c8-a98d-9e170aabc47d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:03.379120 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c9bf41c4-a34b-43c8-a98d-9e170aabc47d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:03.379933 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c9bf41c4-a34b-43c8-a98d-9e170aabc47d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:03.533393 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-c9bf41c4-a34b-43c8-a98d-9e170aabc47d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:03.541974 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-c9bf41c4-a34b-43c8-a98d-9e170aabc47d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1322 microversion: 2.1 time: 0.179708 Jun 23 13:40:03.542906 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 60/110] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:03 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:03.579170 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-9b254fb9-b3f3-418f-b5cd-4e044727ef3a tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:03.579780 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-9b254fb9-b3f3-418f-b5cd-4e044727ef3a tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:03.590337 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9b254fb9-b3f3-418f-b5cd-4e044727ef3a tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:03.590800 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9b254fb9-b3f3-418f-b5cd-4e044727ef3a tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:03.591622 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9b254fb9-b3f3-418f-b5cd-4e044727ef3a tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:03.592064 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9b254fb9-b3f3-418f-b5cd-4e044727ef3a tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:03.761150 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-9b254fb9-b3f3-418f-b5cd-4e044727ef3a tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:03.783167 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-9b254fb9-b3f3-418f-b5cd-4e044727ef3a tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1314 microversion: 2.1 time: 0.208042 Jun 23 13:40:03.786570 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 51/111] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:03 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:04.158740 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-0bf0caaa-fceb-45fd-8ca7-e0aad0d193c5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:04.159614 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-0bf0caaa-fceb-45fd-8ca7-e0aad0d193c5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:04.162254 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell0:SELECT=2 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:04.168046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0bf0caaa-fceb-45fd-8ca7-e0aad0d193c5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:04.168612 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0bf0caaa-fceb-45fd-8ca7-e0aad0d193c5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:04.169381 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0bf0caaa-fceb-45fd-8ca7-e0aad0d193c5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:04.169884 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0bf0caaa-fceb-45fd-8ca7-e0aad0d193c5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:04.189056 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-082c458e-cf6d-485d-a128-3a2b611834ed tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:04.190339 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-082c458e-cf6d-485d-a128-3a2b611834ed tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:04.197383 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-082c458e-cf6d-485d-a128-3a2b611834ed tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:04.197833 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-082c458e-cf6d-485d-a128-3a2b611834ed tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:04.201987 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-082c458e-cf6d-485d-a128-3a2b611834ed tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:04.202660 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-082c458e-cf6d-485d-a128-3a2b611834ed tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:04.393076 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-0bf0caaa-fceb-45fd-8ca7-e0aad0d193c5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:04.400605 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=100 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:04.408304 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-0bf0caaa-fceb-45fd-8ca7-e0aad0d193c5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa" status: 200 len: 1367 microversion: 2.1 time: 0.253817 Jun 23 13:40:04.408901 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 61/112] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:04 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:04.429628 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-082c458e-cf6d-485d-a128-3a2b611834ed tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:04.438846 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-082c458e-cf6d-485d-a128-3a2b611834ed tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:04.440958 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-082c458e-cf6d-485d-a128-3a2b611834ed tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:04.442609 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-082c458e-cf6d-485d-a128-3a2b611834ed tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1406 microversion: 2.20 time: 0.258149 Jun 23 13:40:04.443603 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 52/113] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:40:04 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1406 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:40:04.559223 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-66ab42dd-4f93-4413-974f-9dd9547a92f2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:04.560099 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-66ab42dd-4f93-4413-974f-9dd9547a92f2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:04.566805 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-66ab42dd-4f93-4413-974f-9dd9547a92f2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:04.567956 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-66ab42dd-4f93-4413-974f-9dd9547a92f2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:04.568918 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-66ab42dd-4f93-4413-974f-9dd9547a92f2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:04.569556 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-66ab42dd-4f93-4413-974f-9dd9547a92f2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:04.796276 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-66ab42dd-4f93-4413-974f-9dd9547a92f2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:04.806353 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-e04e6ec7-abcf-4d3a-b3e6-1cc502bb2dd7 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:04.811711 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-e04e6ec7-abcf-4d3a-b3e6-1cc502bb2dd7 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:04.812221 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-66ab42dd-4f93-4413-974f-9dd9547a92f2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1322 microversion: 2.1 time: 0.256769 Jun 23 13:40:04.813259 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 62/114] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:04 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1322 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:04.819424 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e04e6ec7-abcf-4d3a-b3e6-1cc502bb2dd7 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:04.819876 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e04e6ec7-abcf-4d3a-b3e6-1cc502bb2dd7 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:04.820638 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e04e6ec7-abcf-4d3a-b3e6-1cc502bb2dd7 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:04.821068 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e04e6ec7-abcf-4d3a-b3e6-1cc502bb2dd7 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:04.875464 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-325c3bec-ec2d-4c89-aa0e-76f9ee5cbd63 req-af3c694b-62fe-4803-b8e1-1508389b9cbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a45e219e-e492-44d7-a962-1a741b0abcaa", "name": "network-vif-plugged", "status": "completed", "tag": "a620a38f-71e7-45a8-b6c8-6d3333e3b7a7"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:40:04.891209 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-325c3bec-ec2d-4c89-aa0e-76f9ee5cbd63 req-af3c694b-62fe-4803-b8e1-1508389b9cbc service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:04.891957 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-325c3bec-ec2d-4c89-aa0e-76f9ee5cbd63 req-af3c694b-62fe-4803-b8e1-1508389b9cbc service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:04.934169 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-325c3bec-ec2d-4c89-aa0e-76f9ee5cbd63 req-af3c694b-62fe-4803-b8e1-1508389b9cbc service nova] Creating event network-vif-plugged:a620a38f-71e7-45a8-b6c8-6d3333e3b7a7 for instance a45e219e-e492-44d7-a962-1a741b0abcaa on hv-cinder-81558 Jun 23 13:40:04.943211 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-325c3bec-ec2d-4c89-aa0e-76f9ee5cbd63 req-af3c694b-62fe-4803-b8e1-1508389b9cbc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072069 Jun 23 13:40:04.952659 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 63/115] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 13:40:05.052038 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-e04e6ec7-abcf-4d3a-b3e6-1cc502bb2dd7 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:05.073839 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-e04e6ec7-abcf-4d3a-b3e6-1cc502bb2dd7 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1314 microversion: 2.1 time: 0.271549 Jun 23 13:40:05.083398 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 53/116] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:04 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:05.427997 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-90c8019b-eb57-4820-9c8a-8e1a9f2b4c20 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:05.429346 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-90c8019b-eb57-4820-9c8a-8e1a9f2b4c20 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:05.436605 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-90c8019b-eb57-4820-9c8a-8e1a9f2b4c20 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:05.437998 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-90c8019b-eb57-4820-9c8a-8e1a9f2b4c20 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:05.438842 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-90c8019b-eb57-4820-9c8a-8e1a9f2b4c20 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:05.439393 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-90c8019b-eb57-4820-9c8a-8e1a9f2b4c20 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:05.460799 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-a509abc5-6703-4397-866d-0c2308702185 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:05.461750 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-a509abc5-6703-4397-866d-0c2308702185 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:05.472392 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a509abc5-6703-4397-866d-0c2308702185 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:05.472872 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a509abc5-6703-4397-866d-0c2308702185 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:05.473692 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a509abc5-6703-4397-866d-0c2308702185 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:05.474130 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a509abc5-6703-4397-866d-0c2308702185 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:05.646535 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-90c8019b-eb57-4820-9c8a-8e1a9f2b4c20 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:05.655812 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-90c8019b-eb57-4820-9c8a-8e1a9f2b4c20 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa" status: 200 len: 1367 microversion: 2.1 time: 0.233970 Jun 23 13:40:05.656856 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 64/117] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:05 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:40:05.729264 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-a509abc5-6703-4397-866d-0c2308702185 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:05.739367 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-a509abc5-6703-4397-866d-0c2308702185 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:05.741138 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-a509abc5-6703-4397-866d-0c2308702185 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:05.742652 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-a509abc5-6703-4397-866d-0c2308702185 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1406 microversion: 2.20 time: 0.286108 Jun 23 13:40:05.743752 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 54/118] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:40:05 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1406 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 13:40:05.828861 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-32284dc1-5a08-4fca-8ad2-0895f2388cbd tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:05.829471 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-32284dc1-5a08-4fca-8ad2-0895f2388cbd tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:05.835758 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-32284dc1-5a08-4fca-8ad2-0895f2388cbd tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:05.836524 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-32284dc1-5a08-4fca-8ad2-0895f2388cbd tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:05.837277 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-32284dc1-5a08-4fca-8ad2-0895f2388cbd tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:05.837710 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-32284dc1-5a08-4fca-8ad2-0895f2388cbd tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:05.993793 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-32284dc1-5a08-4fca-8ad2-0895f2388cbd tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:06.001568 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-32284dc1-5a08-4fca-8ad2-0895f2388cbd tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1322 microversion: 2.1 time: 0.176560 Jun 23 13:40:06.002135 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 65/119] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:05 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:06.090472 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-fc7fbac9-0868-40b1-ae81-2de794495eac tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:06.091086 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-fc7fbac9-0868-40b1-ae81-2de794495eac tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:06.097917 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fc7fbac9-0868-40b1-ae81-2de794495eac tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:06.098527 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fc7fbac9-0868-40b1-ae81-2de794495eac tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:06.099248 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fc7fbac9-0868-40b1-ae81-2de794495eac tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:06.099712 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fc7fbac9-0868-40b1-ae81-2de794495eac tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:06.237992 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-fc7fbac9-0868-40b1-ae81-2de794495eac tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:06.245725 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-fc7fbac9-0868-40b1-ae81-2de794495eac tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1314 microversion: 2.1 time: 0.159517 Jun 23 13:40:06.246390 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 55/120] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:06 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:06.674337 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-571e1214-20e1-4028-ad0f-de611bb430b5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:06.674862 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-571e1214-20e1-4028-ad0f-de611bb430b5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:06.680942 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-571e1214-20e1-4028-ad0f-de611bb430b5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:06.681391 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-571e1214-20e1-4028-ad0f-de611bb430b5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:06.682129 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-571e1214-20e1-4028-ad0f-de611bb430b5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:06.682574 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-571e1214-20e1-4028-ad0f-de611bb430b5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:06.761632 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-a088fd35-1e85-42d2-8b11-44b3cf9c266b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:06.762825 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-a088fd35-1e85-42d2-8b11-44b3cf9c266b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:06.769537 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a088fd35-1e85-42d2-8b11-44b3cf9c266b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:06.769992 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a088fd35-1e85-42d2-8b11-44b3cf9c266b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:06.770751 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a088fd35-1e85-42d2-8b11-44b3cf9c266b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:06.771320 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a088fd35-1e85-42d2-8b11-44b3cf9c266b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:06.853514 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-571e1214-20e1-4028-ad0f-de611bb430b5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:06.861687 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-571e1214-20e1-4028-ad0f-de611bb430b5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa" status: 200 len: 1557 microversion: 2.1 time: 0.191451 Jun 23 13:40:06.862370 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 66/121] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:06 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa => generated 1557 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:06.884499 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-27ff216a-8137-470a-830a-4cb0e503db3c tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:06.885330 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-27ff216a-8137-470a-830a-4cb0e503db3c tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:06.891452 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-27ff216a-8137-470a-830a-4cb0e503db3c tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:06.891980 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-27ff216a-8137-470a-830a-4cb0e503db3c tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:06.892748 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-27ff216a-8137-470a-830a-4cb0e503db3c tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:06.893172 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-27ff216a-8137-470a-830a-4cb0e503db3c tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:06.925767 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-a088fd35-1e85-42d2-8b11-44b3cf9c266b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:06.934799 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-a088fd35-1e85-42d2-8b11-44b3cf9c266b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:06.936383 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-a088fd35-1e85-42d2-8b11-44b3cf9c266b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:06.937688 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-a088fd35-1e85-42d2-8b11-44b3cf9c266b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1406 microversion: 2.20 time: 0.180019 Jun 23 13:40:06.938312 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 56/122] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:40:06 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:40:07.011690 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-27ff216a-8137-470a-830a-4cb0e503db3c tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131024 Jun 23 13:40:07.012971 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 67/123] 10.222.0.26 () {58 vars in 1274 bytes} [Thu Jun 23 13:40:06 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:40:07.018067 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-424520dd-9c04-4b14-a691-48976201bd10 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:07.018199 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-9eef9e92-8c56-40e8-a43d-b1c005ec15bc req-5227ad20-92d0-4d68-94ed-b13e26920e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e1bdfeb-cac1-45d2-9708-ac7386c20fe4", "name": "network-vif-plugged", "status": "completed", "tag": "5c5684f2-ed9c-4909-9cad-02bd2b76d63d"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:40:07.018810 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-424520dd-9c04-4b14-a691-48976201bd10 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:07.027183 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-424520dd-9c04-4b14-a691-48976201bd10 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:07.027877 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-424520dd-9c04-4b14-a691-48976201bd10 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:07.029029 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-424520dd-9c04-4b14-a691-48976201bd10 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:07.029368 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-9eef9e92-8c56-40e8-a43d-b1c005ec15bc req-5227ad20-92d0-4d68-94ed-b13e26920e27 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:07.029692 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-424520dd-9c04-4b14-a691-48976201bd10 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:07.029969 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-9eef9e92-8c56-40e8-a43d-b1c005ec15bc req-5227ad20-92d0-4d68-94ed-b13e26920e27 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:07.034937 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:SELECT=100 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:07.044820 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-9eef9e92-8c56-40e8-a43d-b1c005ec15bc req-5227ad20-92d0-4d68-94ed-b13e26920e27 service nova] Creating event network-vif-plugged:5c5684f2-ed9c-4909-9cad-02bd2b76d63d for instance 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 on hv-cinder-81558 Jun 23 13:40:07.064416 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-9eef9e92-8c56-40e8-a43d-b1c005ec15bc req-5227ad20-92d0-4d68-94ed-b13e26920e27 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050006 Jun 23 13:40:07.066420 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 57/124] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 13:40:07.204280 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-424520dd-9c04-4b14-a691-48976201bd10 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:07.213402 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-424520dd-9c04-4b14-a691-48976201bd10 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1322 microversion: 2.1 time: 0.198581 Jun 23 13:40:07.214689 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 68/125] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:07 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:40:07.262588 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-ed63e305-7e36-44dd-b6e5-106ee04f4c66 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:07.263275 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-ed63e305-7e36-44dd-b6e5-106ee04f4c66 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:07.272783 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ed63e305-7e36-44dd-b6e5-106ee04f4c66 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:07.273411 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ed63e305-7e36-44dd-b6e5-106ee04f4c66 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:07.274240 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ed63e305-7e36-44dd-b6e5-106ee04f4c66 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:07.274866 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ed63e305-7e36-44dd-b6e5-106ee04f4c66 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:07.405855 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-ed63e305-7e36-44dd-b6e5-106ee04f4c66 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:07.413466 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-ed63e305-7e36-44dd-b6e5-106ee04f4c66 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1314 microversion: 2.1 time: 0.155143 Jun 23 13:40:07.414073 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 58/126] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:07 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:07.956040 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-613d8433-07b8-45e6-b42b-696c7de36ef4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:07.956641 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-613d8433-07b8-45e6-b42b-696c7de36ef4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:07.963387 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-613d8433-07b8-45e6-b42b-696c7de36ef4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:07.963877 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-613d8433-07b8-45e6-b42b-696c7de36ef4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:07.964687 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-613d8433-07b8-45e6-b42b-696c7de36ef4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:07.965147 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-613d8433-07b8-45e6-b42b-696c7de36ef4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:08.092210 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-613d8433-07b8-45e6-b42b-696c7de36ef4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:08.100718 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-613d8433-07b8-45e6-b42b-696c7de36ef4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:08.102218 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-613d8433-07b8-45e6-b42b-696c7de36ef4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:08.108511 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-613d8433-07b8-45e6-b42b-696c7de36ef4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1406 microversion: 2.20 time: 0.151386 Jun 23 13:40:08.108511 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 69/127] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:40:07 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:40:08.231098 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-295dd838-1a92-446a-86f6-31a417ecb4e9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:08.231786 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-295dd838-1a92-446a-86f6-31a417ecb4e9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:08.238068 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-295dd838-1a92-446a-86f6-31a417ecb4e9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:08.238517 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-295dd838-1a92-446a-86f6-31a417ecb4e9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:08.239257 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-295dd838-1a92-446a-86f6-31a417ecb4e9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:08.239766 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-295dd838-1a92-446a-86f6-31a417ecb4e9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:08.374783 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-197cbfb7-0d68-43d1-a5c3-c1f251517239 req-4ba39948-f2e7-42c1-8801-654af8b503ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8dd165f-4996-4336-a117-cd2a9ba751fa", "tag": "b21a6caf-efbc-4abd-ac6f-b37cb3962be9"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:40:08.379035 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-295dd838-1a92-446a-86f6-31a417ecb4e9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:08.384249 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-197cbfb7-0d68-43d1-a5c3-c1f251517239 req-4ba39948-f2e7-42c1-8801-654af8b503ac service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:08.387325 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-295dd838-1a92-446a-86f6-31a417ecb4e9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1322 microversion: 2.1 time: 0.160527 Jun 23 13:40:08.391480 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 59/128] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:08 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:08.391631 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-197cbfb7-0d68-43d1-a5c3-c1f251517239 req-4ba39948-f2e7-42c1-8801-654af8b503ac service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:08.406253 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-197cbfb7-0d68-43d1-a5c3-c1f251517239 req-4ba39948-f2e7-42c1-8801-654af8b503ac service nova] Creating event network-changed:b21a6caf-efbc-4abd-ac6f-b37cb3962be9 for instance f8dd165f-4996-4336-a117-cd2a9ba751fa on hv-cinder-81558 Jun 23 13:40:08.412360 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-197cbfb7-0d68-43d1-a5c3-c1f251517239 req-4ba39948-f2e7-42c1-8801-654af8b503ac service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041215 Jun 23 13:40:08.413270 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 70/129] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:40:08.430496 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-91d85cf8-d16e-4764-a09c-00f3f527a5a1 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:08.431099 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-91d85cf8-d16e-4764-a09c-00f3f527a5a1 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:08.438019 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-91d85cf8-d16e-4764-a09c-00f3f527a5a1 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:08.438445 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-91d85cf8-d16e-4764-a09c-00f3f527a5a1 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:08.439359 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-91d85cf8-d16e-4764-a09c-00f3f527a5a1 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:08.440173 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-91d85cf8-d16e-4764-a09c-00f3f527a5a1 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:08.648909 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-91d85cf8-d16e-4764-a09c-00f3f527a5a1 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:08.660072 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-91d85cf8-d16e-4764-a09c-00f3f527a5a1 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1314 microversion: 2.1 time: 0.233764 Jun 23 13:40:08.661708 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 60/130] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:08 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:09.122886 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-f1d7048e-0cad-4420-bfee-67940843a0ee tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:09.123777 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-f1d7048e-0cad-4420-bfee-67940843a0ee tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:09.131192 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f1d7048e-0cad-4420-bfee-67940843a0ee tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:09.131686 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f1d7048e-0cad-4420-bfee-67940843a0ee tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:09.132449 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f1d7048e-0cad-4420-bfee-67940843a0ee tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:09.132877 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f1d7048e-0cad-4420-bfee-67940843a0ee tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:09.292325 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-f1d7048e-0cad-4420-bfee-67940843a0ee tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:09.305297 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-f1d7048e-0cad-4420-bfee-67940843a0ee tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:09.306909 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-f1d7048e-0cad-4420-bfee-67940843a0ee tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:09.308515 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-f1d7048e-0cad-4420-bfee-67940843a0ee tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1406 microversion: 2.20 time: 0.191096 Jun 23 13:40:09.319233 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 71/131] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:40:09 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:40:09.405254 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-38702c02-5b82-470c-9400-3eb401470e0a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:09.405254 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-38702c02-5b82-470c-9400-3eb401470e0a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:09.411315 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-38702c02-5b82-470c-9400-3eb401470e0a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:09.411798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-38702c02-5b82-470c-9400-3eb401470e0a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:09.412573 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-38702c02-5b82-470c-9400-3eb401470e0a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:09.413011 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-38702c02-5b82-470c-9400-3eb401470e0a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:09.595011 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-38702c02-5b82-470c-9400-3eb401470e0a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:09.603963 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-38702c02-5b82-470c-9400-3eb401470e0a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1322 microversion: 2.1 time: 0.203622 Jun 23 13:40:09.607213 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 61/132] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:09 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:09.679612 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-669e1818-52fa-427a-a4e4-cbf0273e2adf tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:09.680272 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-669e1818-52fa-427a-a4e4-cbf0273e2adf tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:09.687768 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-669e1818-52fa-427a-a4e4-cbf0273e2adf tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:09.693654 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-669e1818-52fa-427a-a4e4-cbf0273e2adf tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:09.694581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-669e1818-52fa-427a-a4e4-cbf0273e2adf tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:09.695026 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-669e1818-52fa-427a-a4e4-cbf0273e2adf tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:09.874532 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-669e1818-52fa-427a-a4e4-cbf0273e2adf tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:09.896869 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-669e1818-52fa-427a-a4e4-cbf0273e2adf tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1314 microversion: 2.1 time: 0.222297 Jun 23 13:40:09.899302 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 72/133] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:09 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:10.326659 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-98f30467-1a78-4f1c-82d4-f9ccdf3b2ecd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:10.327263 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-98f30467-1a78-4f1c-82d4-f9ccdf3b2ecd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:10.336166 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-98f30467-1a78-4f1c-82d4-f9ccdf3b2ecd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:10.336618 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-98f30467-1a78-4f1c-82d4-f9ccdf3b2ecd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:10.337381 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-98f30467-1a78-4f1c-82d4-f9ccdf3b2ecd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:10.337810 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-98f30467-1a78-4f1c-82d4-f9ccdf3b2ecd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:10.389158 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-51866bc4-d18f-44b2-b7ac-d702d4e4e65b req-fdb2525b-d3a0-4339-a471-649fb392af1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9ddb941-db20-4a0c-b841-d99368ad4f21", "name": "network-vif-plugged", "status": "completed", "tag": "07687dd4-8eaf-46e2-8bcb-86dc90291b87"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:40:10.398968 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-51866bc4-d18f-44b2-b7ac-d702d4e4e65b req-fdb2525b-d3a0-4339-a471-649fb392af1e service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:10.401913 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-51866bc4-d18f-44b2-b7ac-d702d4e4e65b req-fdb2525b-d3a0-4339-a471-649fb392af1e service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:10.415119 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-51866bc4-d18f-44b2-b7ac-d702d4e4e65b req-fdb2525b-d3a0-4339-a471-649fb392af1e service nova] Creating event network-vif-plugged:07687dd4-8eaf-46e2-8bcb-86dc90291b87 for instance b9ddb941-db20-4a0c-b841-d99368ad4f21 on hv-cinder-81558 Jun 23 13:40:10.420640 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-51866bc4-d18f-44b2-b7ac-d702d4e4e65b req-fdb2525b-d3a0-4339-a471-649fb392af1e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035043 Jun 23 13:40:10.421732 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 73/134] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 13:40:10.535200 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-98f30467-1a78-4f1c-82d4-f9ccdf3b2ecd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:10.543833 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-98f30467-1a78-4f1c-82d4-f9ccdf3b2ecd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:10.545321 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-98f30467-1a78-4f1c-82d4-f9ccdf3b2ecd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:10.546438 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-98f30467-1a78-4f1c-82d4-f9ccdf3b2ecd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1406 microversion: 2.20 time: 0.224296 Jun 23 13:40:10.547080 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 62/135] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:40:10 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:40:10.624558 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-a69cc9bb-8002-4d0f-816a-452c0629b6ba tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:10.625266 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-a69cc9bb-8002-4d0f-816a-452c0629b6ba tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:10.631891 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a69cc9bb-8002-4d0f-816a-452c0629b6ba tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:10.632555 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a69cc9bb-8002-4d0f-816a-452c0629b6ba tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:10.633800 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a69cc9bb-8002-4d0f-816a-452c0629b6ba tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:10.634389 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a69cc9bb-8002-4d0f-816a-452c0629b6ba tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:10.847889 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-a69cc9bb-8002-4d0f-816a-452c0629b6ba tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:10.857288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-a69cc9bb-8002-4d0f-816a-452c0629b6ba tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1322 microversion: 2.1 time: 0.237014 Jun 23 13:40:10.858313 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 74/136] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:10 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:10.916839 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-d5b717e9-458c-4cd8-93bd-4fff10d31ad5 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:10.917733 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-d5b717e9-458c-4cd8-93bd-4fff10d31ad5 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:10.936322 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d5b717e9-458c-4cd8-93bd-4fff10d31ad5 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:10.936705 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d5b717e9-458c-4cd8-93bd-4fff10d31ad5 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:10.937481 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d5b717e9-458c-4cd8-93bd-4fff10d31ad5 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:10.937925 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d5b717e9-458c-4cd8-93bd-4fff10d31ad5 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:11.182938 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-d5b717e9-458c-4cd8-93bd-4fff10d31ad5 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:11.191297 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-d5b717e9-458c-4cd8-93bd-4fff10d31ad5 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1501 microversion: 2.1 time: 0.280662 Jun 23 13:40:11.191986 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 63/137] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:10 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1501 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:11.573887 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-df7e97eb-d1b7-49fa-9f26-6b902154d7c3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:11.575374 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-df7e97eb-d1b7-49fa-9f26-6b902154d7c3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:11.601451 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-df7e97eb-d1b7-49fa-9f26-6b902154d7c3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:11.602739 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-df7e97eb-d1b7-49fa-9f26-6b902154d7c3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:11.605769 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-df7e97eb-d1b7-49fa-9f26-6b902154d7c3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:11.611562 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-df7e97eb-d1b7-49fa-9f26-6b902154d7c3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:11.845561 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-df7e97eb-d1b7-49fa-9f26-6b902154d7c3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:11.854535 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-df7e97eb-d1b7-49fa-9f26-6b902154d7c3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:11.857069 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-df7e97eb-d1b7-49fa-9f26-6b902154d7c3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:11.858554 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-df7e97eb-d1b7-49fa-9f26-6b902154d7c3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1406 microversion: 2.20 time: 0.297869 Jun 23 13:40:11.860249 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 75/138] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:40:11 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1406 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:40:11.874379 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-9ec93c00-fa5d-4a90-bca5-ee446fc17a61 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:11.875036 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-9ec93c00-fa5d-4a90-bca5-ee446fc17a61 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:11.881139 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9ec93c00-fa5d-4a90-bca5-ee446fc17a61 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:11.881757 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9ec93c00-fa5d-4a90-bca5-ee446fc17a61 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:11.882531 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9ec93c00-fa5d-4a90-bca5-ee446fc17a61 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:11.882962 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9ec93c00-fa5d-4a90-bca5-ee446fc17a61 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:12.023791 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-9ec93c00-fa5d-4a90-bca5-ee446fc17a61 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:12.033693 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-9ec93c00-fa5d-4a90-bca5-ee446fc17a61 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1514 microversion: 2.1 time: 0.163246 Jun 23 13:40:12.043384 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 64/139] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:11 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:12.053213 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-b6a97ac1-9bb6-4958-becd-645e2e178752 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:40:12.054622 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-b6a97ac1-9bb6-4958-becd-645e2e178752 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:12.060817 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b6a97ac1-9bb6-4958-becd-645e2e178752 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:12.061266 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b6a97ac1-9bb6-4958-becd-645e2e178752 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:12.062515 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b6a97ac1-9bb6-4958-becd-645e2e178752 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:12.063083 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b6a97ac1-9bb6-4958-becd-645e2e178752 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:12.092679 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.objects.instance [None req-b6a97ac1-9bb6-4958-becd-645e2e178752 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lazy-loading 'flavor' on Instance uuid a45e219e-e492-44d7-a962-1a741b0abcaa {{(pid=134667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:40:12.277860 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-b6a97ac1-9bb6-4958-becd-645e2e178752 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "POST /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa/action" status: 200 len: 32 microversion: 2.1 time: 0.229017 Jun 23 13:40:12.279099 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 76/140] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Jun 23 13:40:12 2022] POST /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa/action => generated 32 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 13:40:12.293830 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c10731b6-fd9d-4f85-ad63-f12aebbabe43 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:12.294477 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-c10731b6-fd9d-4f85-ad63-f12aebbabe43 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:12.301948 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c10731b6-fd9d-4f85-ad63-f12aebbabe43 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:12.302668 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c10731b6-fd9d-4f85-ad63-f12aebbabe43 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:12.303473 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c10731b6-fd9d-4f85-ad63-f12aebbabe43 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:12.303962 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c10731b6-fd9d-4f85-ad63-f12aebbabe43 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:12.477632 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-c10731b6-fd9d-4f85-ad63-f12aebbabe43 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:12.485672 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-c10731b6-fd9d-4f85-ad63-f12aebbabe43 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.200522 Jun 23 13:40:12.486241 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 65/141] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:12 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:12.778555 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-68287948-728d-4d0f-951d-496343912509 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "896f7b36-189e-4d1a-aac3-ac0e1f8b5447"}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:40:12.781299 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-68287948-728d-4d0f-951d-496343912509 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:12.789769 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-68287948-728d-4d0f-951d-496343912509 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:12.790221 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-68287948-728d-4d0f-951d-496343912509 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:12.791183 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-68287948-728d-4d0f-951d-496343912509 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:12.791643 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-68287948-728d-4d0f-951d-496343912509 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:12.879523 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-07221f15-9507-4b6d-9a00-aea9d1137904 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:12.881296 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-07221f15-9507-4b6d-9a00-aea9d1137904 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:12.890596 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-07221f15-9507-4b6d-9a00-aea9d1137904 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:12.903629 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-07221f15-9507-4b6d-9a00-aea9d1137904 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:12.908575 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-07221f15-9507-4b6d-9a00-aea9d1137904 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:12.909487 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-07221f15-9507-4b6d-9a00-aea9d1137904 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:13.107687 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-07221f15-9507-4b6d-9a00-aea9d1137904 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:13.113035 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-07221f15-9507-4b6d-9a00-aea9d1137904 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:13.114581 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-07221f15-9507-4b6d-9a00-aea9d1137904 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:13.115771 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-07221f15-9507-4b6d-9a00-aea9d1137904 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1406 microversion: 2.20 time: 0.241440 Jun 23 13:40:13.123672 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 66/142] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:40:12 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1406 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:40:13.502753 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-7b2ba559-b356-482d-96b5-4fa773eaccca tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:13.503391 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-7b2ba559-b356-482d-96b5-4fa773eaccca tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:13.515850 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7b2ba559-b356-482d-96b5-4fa773eaccca tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:13.516210 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7b2ba559-b356-482d-96b5-4fa773eaccca tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:13.516977 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7b2ba559-b356-482d-96b5-4fa773eaccca tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:13.517410 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7b2ba559-b356-482d-96b5-4fa773eaccca tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:13.710221 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-7b2ba559-b356-482d-96b5-4fa773eaccca tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:13.720282 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-7b2ba559-b356-482d-96b5-4fa773eaccca tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.221466 Jun 23 13:40:13.721050 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 67/143] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:13 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:14.005003 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:14.036258 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-68287948-728d-4d0f-951d-496343912509 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "POST /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.262739 Jun 23 13:40:14.037173 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 77/144] 10.222.0.26 () {60 vars in 1322 bytes} [Thu Jun 23 13:40:12 2022] POST /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4/os-volume_attachments => generated 194 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:40:14.135933 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-5364d9b9-f8c7-4a6c-9c98-a22576637a81 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:14.137240 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-5364d9b9-f8c7-4a6c-9c98-a22576637a81 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:14.142594 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5364d9b9-f8c7-4a6c-9c98-a22576637a81 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:14.143076 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5364d9b9-f8c7-4a6c-9c98-a22576637a81 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:14.143903 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5364d9b9-f8c7-4a6c-9c98-a22576637a81 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:14.144330 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5364d9b9-f8c7-4a6c-9c98-a22576637a81 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:14.579771 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-5364d9b9-f8c7-4a6c-9c98-a22576637a81 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:14.589427 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-5364d9b9-f8c7-4a6c-9c98-a22576637a81 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:14.590878 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-5364d9b9-f8c7-4a6c-9c98-a22576637a81 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:14.592220 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-5364d9b9-f8c7-4a6c-9c98-a22576637a81 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1597 microversion: 2.20 time: 0.461361 Jun 23 13:40:14.592633 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 68/145] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:40:14 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1597 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:40:14.614170 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-972b11f7-d55c-4cfe-b018-8a2f4ffd4a8e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:14.614920 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-972b11f7-d55c-4cfe-b018-8a2f4ffd4a8e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:14.620164 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_api:SELECT=90 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:14.635014 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-972b11f7-d55c-4cfe-b018-8a2f4ffd4a8e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:14.635785 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-972b11f7-d55c-4cfe-b018-8a2f4ffd4a8e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:14.637590 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-972b11f7-d55c-4cfe-b018-8a2f4ffd4a8e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:14.638533 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-972b11f7-d55c-4cfe-b018-8a2f4ffd4a8e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:14.741690 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-972b11f7-d55c-4cfe-b018-8a2f4ffd4a8e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.133258 Jun 23 13:40:14.742291 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 78/146] 10.222.0.26 () {60 vars in 1315 bytes} [Thu Jun 23 13:40:14 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 13:40:14.744122 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-872a1aa1-2061-4eb4-aff6-874d692fd539 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:14.745138 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-872a1aa1-2061-4eb4-aff6-874d692fd539 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:14.752901 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-872a1aa1-2061-4eb4-aff6-874d692fd539 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:14.753349 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-872a1aa1-2061-4eb4-aff6-874d692fd539 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:14.754375 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-872a1aa1-2061-4eb4-aff6-874d692fd539 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:14.755116 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-872a1aa1-2061-4eb4-aff6-874d692fd539 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:15.087510 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-872a1aa1-2061-4eb4-aff6-874d692fd539 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:15.099781 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-872a1aa1-2061-4eb4-aff6-874d692fd539 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.363352 Jun 23 13:40:15.100926 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 69/147] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:14 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:40:16.117330 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-79260b3b-b851-40d1-a5d5-5aa5c1562afb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:16.121095 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-79260b3b-b851-40d1-a5d5-5aa5c1562afb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:16.126299 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-79260b3b-b851-40d1-a5d5-5aa5c1562afb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:16.126964 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-79260b3b-b851-40d1-a5d5-5aa5c1562afb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:16.128140 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-79260b3b-b851-40d1-a5d5-5aa5c1562afb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:16.128832 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-79260b3b-b851-40d1-a5d5-5aa5c1562afb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:16.337991 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-db4f16ea-8070-45a2-b9a6-f8c80d272092 req-4b7269c1-ed7d-4b20-aae9-8991f6be09c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9ddb941-db20-4a0c-b841-d99368ad4f21", "tag": "07687dd4-8eaf-46e2-8bcb-86dc90291b87"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:40:16.363795 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-db4f16ea-8070-45a2-b9a6-f8c80d272092 req-4b7269c1-ed7d-4b20-aae9-8991f6be09c3 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:16.364580 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-db4f16ea-8070-45a2-b9a6-f8c80d272092 req-4b7269c1-ed7d-4b20-aae9-8991f6be09c3 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:16.390148 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-db4f16ea-8070-45a2-b9a6-f8c80d272092 req-4b7269c1-ed7d-4b20-aae9-8991f6be09c3 service nova] Creating event network-changed:07687dd4-8eaf-46e2-8bcb-86dc90291b87 for instance b9ddb941-db20-4a0c-b841-d99368ad4f21 on hv-cinder-81558 Jun 23 13:40:16.403614 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-db4f16ea-8070-45a2-b9a6-f8c80d272092 req-4b7269c1-ed7d-4b20-aae9-8991f6be09c3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073104 Jun 23 13:40:16.404299 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 70/148] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 13:40:16.434287 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-79260b3b-b851-40d1-a5d5-5aa5c1562afb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:16.446279 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-79260b3b-b851-40d1-a5d5-5aa5c1562afb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.331344 Jun 23 13:40:16.457280 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 79/149] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:16 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:17.467500 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-982d05c4-df46-437a-8908-f62e0c98692e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:17.468843 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-982d05c4-df46-437a-8908-f62e0c98692e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:17.484294 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-982d05c4-df46-437a-8908-f62e0c98692e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:17.484756 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-982d05c4-df46-437a-8908-f62e0c98692e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:17.492205 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-982d05c4-df46-437a-8908-f62e0c98692e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:17.493050 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-982d05c4-df46-437a-8908-f62e0c98692e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:18.120649 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-982d05c4-df46-437a-8908-f62e0c98692e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:18.132029 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-982d05c4-df46-437a-8908-f62e0c98692e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.671995 Jun 23 13:40:18.134180 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 71/150] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:17 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:19.150647 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-55fa498b-317c-4b04-adcb-9505332b6eb3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:19.151260 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-55fa498b-317c-4b04-adcb-9505332b6eb3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:19.162278 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-55fa498b-317c-4b04-adcb-9505332b6eb3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:19.165423 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-55fa498b-317c-4b04-adcb-9505332b6eb3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:19.168343 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-55fa498b-317c-4b04-adcb-9505332b6eb3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:19.171354 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-55fa498b-317c-4b04-adcb-9505332b6eb3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:19.570616 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-55fa498b-317c-4b04-adcb-9505332b6eb3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:19.593128 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-55fa498b-317c-4b04-adcb-9505332b6eb3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.445470 Jun 23 13:40:19.594228 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 80/151] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:19 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:20.611144 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-aa046e1e-e894-4dd5-8ff8-8cbd0491d87b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:20.613008 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-aa046e1e-e894-4dd5-8ff8-8cbd0491d87b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:20.624143 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-aa046e1e-e894-4dd5-8ff8-8cbd0491d87b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:20.625248 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-aa046e1e-e894-4dd5-8ff8-8cbd0491d87b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:20.627438 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-aa046e1e-e894-4dd5-8ff8-8cbd0491d87b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:20.628971 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-aa046e1e-e894-4dd5-8ff8-8cbd0491d87b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:20.846886 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-aa046e1e-e894-4dd5-8ff8-8cbd0491d87b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:20.857670 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-aa046e1e-e894-4dd5-8ff8-8cbd0491d87b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.250805 Jun 23 13:40:20.858522 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 72/152] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:20 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:21.885108 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-c7d21365-4503-4bc1-8330-12c29a979138 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:21.887577 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-c7d21365-4503-4bc1-8330-12c29a979138 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:21.919981 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c7d21365-4503-4bc1-8330-12c29a979138 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:21.922195 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c7d21365-4503-4bc1-8330-12c29a979138 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:21.923443 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c7d21365-4503-4bc1-8330-12c29a979138 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:21.925139 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c7d21365-4503-4bc1-8330-12c29a979138 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:22.158588 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-c7d21365-4503-4bc1-8330-12c29a979138 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:22.193317 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-c7d21365-4503-4bc1-8330-12c29a979138 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.322678 Jun 23 13:40:22.198414 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 81/153] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:21 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:23.119714 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-a070ab7d-ddf7-42a5-8af7-4d99c5b09fb8 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:23.120830 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-a070ab7d-ddf7-42a5-8af7-4d99c5b09fb8 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:23.127548 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a070ab7d-ddf7-42a5-8af7-4d99c5b09fb8 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:23.128001 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a070ab7d-ddf7-42a5-8af7-4d99c5b09fb8 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:23.128763 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a070ab7d-ddf7-42a5-8af7-4d99c5b09fb8 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:23.129369 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a070ab7d-ddf7-42a5-8af7-4d99c5b09fb8 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:23.155470 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-a070ab7d-ddf7-42a5-8af7-4d99c5b09fb8 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Going to try to terminate instance {{(pid=134666) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 13:40:23.217400 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-9b6dce17-0ea9-447b-8c1e-9eaecb39edc4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:23.220088 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-9b6dce17-0ea9-447b-8c1e-9eaecb39edc4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:23.233661 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9b6dce17-0ea9-447b-8c1e-9eaecb39edc4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:23.234617 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9b6dce17-0ea9-447b-8c1e-9eaecb39edc4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:23.235637 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9b6dce17-0ea9-447b-8c1e-9eaecb39edc4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:23.236272 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9b6dce17-0ea9-447b-8c1e-9eaecb39edc4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:23.271470 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:23.297337 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_api:SELECT=82 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:23.317043 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-a070ab7d-ddf7-42a5-8af7-4d99c5b09fb8 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 204 len: 0 microversion: 2.1 time: 0.200640 Jun 23 13:40:23.318271 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 73/154] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Jun 23 13:40:23 2022] DELETE /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 13:40:23.331277 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-b2a2e897-4dea-4a13-b7a3-df8e44672620 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:23.337013 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-b2a2e897-4dea-4a13-b7a3-df8e44672620 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:23.365068 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b2a2e897-4dea-4a13-b7a3-df8e44672620 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:23.365694 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b2a2e897-4dea-4a13-b7a3-df8e44672620 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:23.370405 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b2a2e897-4dea-4a13-b7a3-df8e44672620 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:23.371161 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b2a2e897-4dea-4a13-b7a3-df8e44672620 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:23.523712 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-9b6dce17-0ea9-447b-8c1e-9eaecb39edc4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:23.534030 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-9b6dce17-0ea9-447b-8c1e-9eaecb39edc4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.325049 Jun 23 13:40:23.536569 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 82/155] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:23 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:23.604329 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-b2a2e897-4dea-4a13-b7a3-df8e44672620 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:23.613245 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-b2a2e897-4dea-4a13-b7a3-df8e44672620 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1553 microversion: 2.1 time: 0.290782 Jun 23 13:40:23.614063 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 74/156] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:23 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1553 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:24.554662 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-d6dd0adb-607e-4284-ad06-84672e6158bc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:24.555324 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-d6dd0adb-607e-4284-ad06-84672e6158bc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:24.572508 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d6dd0adb-607e-4284-ad06-84672e6158bc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:24.573042 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d6dd0adb-607e-4284-ad06-84672e6158bc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:24.574004 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d6dd0adb-607e-4284-ad06-84672e6158bc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:24.574618 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d6dd0adb-607e-4284-ad06-84672e6158bc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:24.630911 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-6d4b5c31-80ce-4987-8e2d-9a1302e6a5e5 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:24.633576 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-6d4b5c31-80ce-4987-8e2d-9a1302e6a5e5 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:24.640154 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6d4b5c31-80ce-4987-8e2d-9a1302e6a5e5 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:24.643606 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6d4b5c31-80ce-4987-8e2d-9a1302e6a5e5 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:24.647405 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6d4b5c31-80ce-4987-8e2d-9a1302e6a5e5 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:24.649375 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6d4b5c31-80ce-4987-8e2d-9a1302e6a5e5 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:24.858926 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-6d4b5c31-80ce-4987-8e2d-9a1302e6a5e5 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:24.875261 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-6d4b5c31-80ce-4987-8e2d-9a1302e6a5e5 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1553 microversion: 2.1 time: 0.248996 Jun 23 13:40:24.876234 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 75/157] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:24 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1553 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:40:24.965167 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-d6dd0adb-607e-4284-ad06-84672e6158bc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:24.975037 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-d6dd0adb-607e-4284-ad06-84672e6158bc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.424388 Jun 23 13:40:24.975663 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 83/158] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:24 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:25.892824 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-2fa3a840-6ca0-4972-8cd0-45eb559eeb02 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:25.893453 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-2fa3a840-6ca0-4972-8cd0-45eb559eeb02 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:25.904811 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2fa3a840-6ca0-4972-8cd0-45eb559eeb02 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:25.905182 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2fa3a840-6ca0-4972-8cd0-45eb559eeb02 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:25.905967 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2fa3a840-6ca0-4972-8cd0-45eb559eeb02 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:25.906398 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2fa3a840-6ca0-4972-8cd0-45eb559eeb02 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:25.997229 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-0b60160a-55af-4ba5-82f9-14914e0ed717 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:25.997892 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-0b60160a-55af-4ba5-82f9-14914e0ed717 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:26.005665 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0b60160a-55af-4ba5-82f9-14914e0ed717 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:26.006271 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0b60160a-55af-4ba5-82f9-14914e0ed717 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:26.007290 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0b60160a-55af-4ba5-82f9-14914e0ed717 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:26.008046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0b60160a-55af-4ba5-82f9-14914e0ed717 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:26.165027 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-2fa3a840-6ca0-4972-8cd0-45eb559eeb02 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:26.173818 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-2fa3a840-6ca0-4972-8cd0-45eb559eeb02 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1553 microversion: 2.1 time: 0.285061 Jun 23 13:40:26.174647 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 76/159] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:25 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1553 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:26.231145 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-0b60160a-55af-4ba5-82f9-14914e0ed717 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:26.239517 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-0b60160a-55af-4ba5-82f9-14914e0ed717 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.247910 Jun 23 13:40:26.240520 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 84/160] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:25 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:40:26.660066 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-9349cbe7-067e-40ba-aa42-71564757c369 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Action: 'create', calling method: .version_select at 0x7fd7727bcee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-150071967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuumkp/msMuu5x19HW7zdlOT6hSYM58MWr7yMCbrWQFr0OdYaIZH+G4diCuCXzoDobXgBUlwbbOYJtxQSWUxcKUA6calMsCjPlfm4+wpRbTVNFaNtxrCaldr+5ffLJd6w=="}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:40:26.674850 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-9349cbe7-067e-40ba-aa42-71564757c369 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Getting quotas for project b2fef8d0cb974f35a741c3090fda97f1. Resources: {'key_pairs'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:40:26.678751 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-9349cbe7-067e-40ba-aa42-71564757c369 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Getting quotas for user e7e1bce062244098888ecb72b11ccd88 and project b2fef8d0cb974f35a741c3090fda97f1. Resources: {'key_pairs'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:40:26.703207 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-9349cbe7-067e-40ba-aa42-71564757c369 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.258326 Jun 23 13:40:26.703866 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 77/161] 10.222.0.26 () {60 vars in 1158 bytes} [Thu Jun 23 13:40:26 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:40:27.190627 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-9e2b4f18-14e0-4ae0-8869-6c311f57e266 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:27.191311 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-9e2b4f18-14e0-4ae0-8869-6c311f57e266 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:27.205895 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9e2b4f18-14e0-4ae0-8869-6c311f57e266 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:27.206683 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9e2b4f18-14e0-4ae0-8869-6c311f57e266 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:27.207636 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9e2b4f18-14e0-4ae0-8869-6c311f57e266 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:27.208211 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9e2b4f18-14e0-4ae0-8869-6c311f57e266 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:27.258271 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-0add8c6a-a5b1-4451-9a2e-8db2840fc503 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:27.259622 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-0add8c6a-a5b1-4451-9a2e-8db2840fc503 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:27.267970 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0add8c6a-a5b1-4451-9a2e-8db2840fc503 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:27.268574 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0add8c6a-a5b1-4451-9a2e-8db2840fc503 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:27.269657 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0add8c6a-a5b1-4451-9a2e-8db2840fc503 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:27.271104 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0add8c6a-a5b1-4451-9a2e-8db2840fc503 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:27.474236 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-9e2b4f18-14e0-4ae0-8869-6c311f57e266 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:27.485213 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-9e2b4f18-14e0-4ae0-8869-6c311f57e266 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1553 microversion: 2.1 time: 0.298474 Jun 23 13:40:27.485697 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 85/162] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:27 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1553 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:27.523977 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-0add8c6a-a5b1-4451-9a2e-8db2840fc503 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:27.532773 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-0add8c6a-a5b1-4451-9a2e-8db2840fc503 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.280091 Jun 23 13:40:27.533348 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 78/163] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:27 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:28.502515 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-898de165-846c-4881-91bd-03300cf30907 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:28.503223 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-898de165-846c-4881-91bd-03300cf30907 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:28.511403 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-898de165-846c-4881-91bd-03300cf30907 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:28.512233 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-898de165-846c-4881-91bd-03300cf30907 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:28.513245 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-898de165-846c-4881-91bd-03300cf30907 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:28.514000 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-898de165-846c-4881-91bd-03300cf30907 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:28.550505 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-1ed3b856-36af-411c-ae00-8be1d65b7142 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:28.551236 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-1ed3b856-36af-411c-ae00-8be1d65b7142 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:28.565602 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1ed3b856-36af-411c-ae00-8be1d65b7142 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:28.566184 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1ed3b856-36af-411c-ae00-8be1d65b7142 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:28.568042 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1ed3b856-36af-411c-ae00-8be1d65b7142 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:28.573684 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1ed3b856-36af-411c-ae00-8be1d65b7142 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:28.832752 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-898de165-846c-4881-91bd-03300cf30907 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:28.836210 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-1ed3b856-36af-411c-ae00-8be1d65b7142 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:28.843098 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-898de165-846c-4881-91bd-03300cf30907 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1553 microversion: 2.1 time: 0.344783 Jun 23 13:40:28.844285 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 86/164] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:28 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1553 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:28.844569 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-1ed3b856-36af-411c-ae00-8be1d65b7142 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.298415 Jun 23 13:40:28.845208 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 79/165] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:28 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:29.861741 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-1fcbbbf6-305e-48a2-8f1b-261d0c7b6a69 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:29.862474 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-6fc5a062-6f89-4453-b2b5-af2308ecb225 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:29.862867 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-1fcbbbf6-305e-48a2-8f1b-261d0c7b6a69 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:29.863323 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-6fc5a062-6f89-4453-b2b5-af2308ecb225 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:29.869145 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1fcbbbf6-305e-48a2-8f1b-261d0c7b6a69 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:29.869907 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1fcbbbf6-305e-48a2-8f1b-261d0c7b6a69 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:29.870029 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6fc5a062-6f89-4453-b2b5-af2308ecb225 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:29.870381 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6fc5a062-6f89-4453-b2b5-af2308ecb225 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:29.870682 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1fcbbbf6-305e-48a2-8f1b-261d0c7b6a69 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:29.871097 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1fcbbbf6-305e-48a2-8f1b-261d0c7b6a69 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:29.871259 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6fc5a062-6f89-4453-b2b5-af2308ecb225 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:29.871711 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6fc5a062-6f89-4453-b2b5-af2308ecb225 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:30.078601 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-1fcbbbf6-305e-48a2-8f1b-261d0c7b6a69 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:30.082504 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-6fc5a062-6f89-4453-b2b5-af2308ecb225 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:30.093253 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-1fcbbbf6-305e-48a2-8f1b-261d0c7b6a69 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1553 microversion: 2.1 time: 0.235310 Jun 23 13:40:30.101003 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-6fc5a062-6f89-4453-b2b5-af2308ecb225 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.243233 Jun 23 13:40:30.102135 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 87/166] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:29 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:30.104798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 80/167] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:29 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1553 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:31.110988 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-b2425d89-ee69-4585-b7e2-42124c79ae9d tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:31.113166 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-b2425d89-ee69-4585-b7e2-42124c79ae9d tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:31.118121 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-af52714b-76d4-4ea1-9606-b978036cbe72 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:31.118591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b2425d89-ee69-4585-b7e2-42124c79ae9d tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:31.118591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b2425d89-ee69-4585-b7e2-42124c79ae9d tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:31.119397 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b2425d89-ee69-4585-b7e2-42124c79ae9d tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:31.119524 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-af52714b-76d4-4ea1-9606-b978036cbe72 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:31.119827 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b2425d89-ee69-4585-b7e2-42124c79ae9d tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:31.126041 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-af52714b-76d4-4ea1-9606-b978036cbe72 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:31.126722 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-af52714b-76d4-4ea1-9606-b978036cbe72 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:31.127515 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-af52714b-76d4-4ea1-9606-b978036cbe72 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:31.128295 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-af52714b-76d4-4ea1-9606-b978036cbe72 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:31.532023 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-b2425d89-ee69-4585-b7e2-42124c79ae9d tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:31.543719 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-b2425d89-ee69-4585-b7e2-42124c79ae9d tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1553 microversion: 2.1 time: 0.437115 Jun 23 13:40:31.544614 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 88/168] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:31 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1553 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:40:31.546544 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-af52714b-76d4-4ea1-9606-b978036cbe72 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:31.557276 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-af52714b-76d4-4ea1-9606-b978036cbe72 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.442811 Jun 23 13:40:31.558325 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 81/169] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:31 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:32.564841 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-8c4af4bb-272d-4ac6-885d-65ea18fddd58 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:32.565601 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-8c4af4bb-272d-4ac6-885d-65ea18fddd58 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:32.572300 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8c4af4bb-272d-4ac6-885d-65ea18fddd58 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:32.572767 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8c4af4bb-272d-4ac6-885d-65ea18fddd58 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:32.573531 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8c4af4bb-272d-4ac6-885d-65ea18fddd58 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:32.573954 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8c4af4bb-272d-4ac6-885d-65ea18fddd58 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:32.574719 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c60b1629-b5ad-4d80-a14f-79503d732152 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:32.575471 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-c60b1629-b5ad-4d80-a14f-79503d732152 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:32.581934 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c60b1629-b5ad-4d80-a14f-79503d732152 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:32.582453 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c60b1629-b5ad-4d80-a14f-79503d732152 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:32.583368 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c60b1629-b5ad-4d80-a14f-79503d732152 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:32.583894 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c60b1629-b5ad-4d80-a14f-79503d732152 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:32.789314 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-8c4af4bb-272d-4ac6-885d-65ea18fddd58 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:32.790733 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-c60b1629-b5ad-4d80-a14f-79503d732152 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:32.798765 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-c60b1629-b5ad-4d80-a14f-79503d732152 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.228716 Jun 23 13:40:32.801272 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-8c4af4bb-272d-4ac6-885d-65ea18fddd58 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1553 microversion: 2.1 time: 0.240617 Jun 23 13:40:32.802444 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 89/170] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:32 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1553 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:32.803495 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 82/171] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:32 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:32.876109 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-29fdd148-8146-4620-a2da-b34c1a30113c req-a5888ac8-8c4c-44d0-bbf5-52a93bc7fbb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e1bdfeb-cac1-45d2-9708-ac7386c20fe4", "name": "network-vif-deleted", "tag": "5c5684f2-ed9c-4909-9cad-02bd2b76d63d"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:40:32.884356 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-29fdd148-8146-4620-a2da-b34c1a30113c req-a5888ac8-8c4c-44d0-bbf5-52a93bc7fbb7 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:32.884807 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-29fdd148-8146-4620-a2da-b34c1a30113c req-a5888ac8-8c4c-44d0-bbf5-52a93bc7fbb7 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:32.896121 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-29fdd148-8146-4620-a2da-b34c1a30113c req-a5888ac8-8c4c-44d0-bbf5-52a93bc7fbb7 service nova] Creating event network-vif-deleted:5c5684f2-ed9c-4909-9cad-02bd2b76d63d for instance 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 on hv-cinder-81558 Jun 23 13:40:32.901486 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-29fdd148-8146-4620-a2da-b34c1a30113c req-a5888ac8-8c4c-44d0-bbf5-52a93bc7fbb7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028885 Jun 23 13:40:32.902098 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 90/172] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:40:33.823685 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-e4a61a2a-ecdd-4580-bac2-fa9592c7563d tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:33.824207 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-e4a61a2a-ecdd-4580-bac2-fa9592c7563d tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:33.826664 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-2853e581-2f49-4452-898d-93d891edef80 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:33.827758 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-2853e581-2f49-4452-898d-93d891edef80 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:33.830691 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e4a61a2a-ecdd-4580-bac2-fa9592c7563d tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:33.831141 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e4a61a2a-ecdd-4580-bac2-fa9592c7563d tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:33.831945 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e4a61a2a-ecdd-4580-bac2-fa9592c7563d tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:33.832378 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e4a61a2a-ecdd-4580-bac2-fa9592c7563d tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:33.834040 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2853e581-2f49-4452-898d-93d891edef80 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:33.834502 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2853e581-2f49-4452-898d-93d891edef80 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:33.835484 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2853e581-2f49-4452-898d-93d891edef80 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:33.836253 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2853e581-2f49-4452-898d-93d891edef80 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:33.926578 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-e4a61a2a-ecdd-4580-bac2-fa9592c7563d tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:33.938008 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-e4a61a2a-ecdd-4580-bac2-fa9592c7563d tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1511 microversion: 2.1 time: 0.119538 Jun 23 13:40:33.941126 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 83/173] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:33 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1511 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:33.994503 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-2853e581-2f49-4452-898d-93d891edef80 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:34.004555 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-2853e581-2f49-4452-898d-93d891edef80 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.184954 Jun 23 13:40:34.005123 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 91/174] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:33 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:34.955323 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-91f4b113-2ad4-4cd3-b0ab-cef0786d410e tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:34.955996 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-91f4b113-2ad4-4cd3-b0ab-cef0786d410e tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:34.963435 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-91f4b113-2ad4-4cd3-b0ab-cef0786d410e tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:34.963830 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-91f4b113-2ad4-4cd3-b0ab-cef0786d410e tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:34.964871 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-91f4b113-2ad4-4cd3-b0ab-cef0786d410e tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:34.965296 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-91f4b113-2ad4-4cd3-b0ab-cef0786d410e tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:35.024813 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-5af157e9-cbe7-48e3-8c41-97315580aba1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:35.025698 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-5af157e9-cbe7-48e3-8c41-97315580aba1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:35.030923 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-91f4b113-2ad4-4cd3-b0ab-cef0786d410e tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:35.033155 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5af157e9-cbe7-48e3-8c41-97315580aba1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:35.033673 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5af157e9-cbe7-48e3-8c41-97315580aba1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:35.034511 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5af157e9-cbe7-48e3-8c41-97315580aba1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:35.035022 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5af157e9-cbe7-48e3-8c41-97315580aba1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:35.039620 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-91f4b113-2ad4-4cd3-b0ab-cef0786d410e tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1345 microversion: 2.1 time: 0.088484 Jun 23 13:40:35.040252 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 84/175] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:34 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1345 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:35.180164 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-5af157e9-cbe7-48e3-8c41-97315580aba1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:35.186195 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-5af157e9-cbe7-48e3-8c41-97315580aba1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.166271 Jun 23 13:40:35.186907 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 92/176] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:35 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:36.057082 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-f5051525-b96a-4ea1-8a41-2b8c033822fe tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:36.057671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-f5051525-b96a-4ea1-8a41-2b8c033822fe tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:36.064631 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f5051525-b96a-4ea1-8a41-2b8c033822fe tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:36.065055 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f5051525-b96a-4ea1-8a41-2b8c033822fe tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:36.066051 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f5051525-b96a-4ea1-8a41-2b8c033822fe tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:36.066502 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f5051525-b96a-4ea1-8a41-2b8c033822fe tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:36.127993 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-f5051525-b96a-4ea1-8a41-2b8c033822fe tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:36.136873 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-f5051525-b96a-4ea1-8a41-2b8c033822fe tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1345 microversion: 2.1 time: 0.083564 Jun 23 13:40:36.137624 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 85/177] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:36 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:36.203729 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-3b4bae3d-c35d-4ef6-a324-0e46d92237f9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:36.205660 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-3b4bae3d-c35d-4ef6-a324-0e46d92237f9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:36.213173 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3b4bae3d-c35d-4ef6-a324-0e46d92237f9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:36.213634 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3b4bae3d-c35d-4ef6-a324-0e46d92237f9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:36.214404 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3b4bae3d-c35d-4ef6-a324-0e46d92237f9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:36.214844 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3b4bae3d-c35d-4ef6-a324-0e46d92237f9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:36.358405 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-3b4bae3d-c35d-4ef6-a324-0e46d92237f9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:36.366422 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-3b4bae3d-c35d-4ef6-a324-0e46d92237f9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.166571 Jun 23 13:40:36.366994 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 93/178] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:36 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:37.156251 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-388dd734-2412-413c-822e-20d2e71d1d19 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:37.157323 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-388dd734-2412-413c-822e-20d2e71d1d19 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:37.161714 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell0:SELECT=4 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:37.165933 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-388dd734-2412-413c-822e-20d2e71d1d19 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:37.166370 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-388dd734-2412-413c-822e-20d2e71d1d19 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:37.167137 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-388dd734-2412-413c-822e-20d2e71d1d19 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:37.167604 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-388dd734-2412-413c-822e-20d2e71d1d19 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:37.232874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-388dd734-2412-413c-822e-20d2e71d1d19 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:37.241857 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-388dd734-2412-413c-822e-20d2e71d1d19 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1345 microversion: 2.1 time: 0.091399 Jun 23 13:40:37.242459 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 86/179] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:37 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1345 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:37.384163 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-0159bda9-1f85-4f9f-9442-1c6fdebb9523 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:37.384735 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-0159bda9-1f85-4f9f-9442-1c6fdebb9523 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:37.391697 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0159bda9-1f85-4f9f-9442-1c6fdebb9523 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:37.392147 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0159bda9-1f85-4f9f-9442-1c6fdebb9523 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:37.392936 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0159bda9-1f85-4f9f-9442-1c6fdebb9523 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:37.393366 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0159bda9-1f85-4f9f-9442-1c6fdebb9523 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:37.526071 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-0159bda9-1f85-4f9f-9442-1c6fdebb9523 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:37.533655 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-0159bda9-1f85-4f9f-9442-1c6fdebb9523 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.153567 Jun 23 13:40:37.534224 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 94/180] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:37 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:38.260523 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-7c1e1d53-cdf7-478c-a339-984696c06766 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:38.261171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-7c1e1d53-cdf7-478c-a339-984696c06766 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:38.268000 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7c1e1d53-cdf7-478c-a339-984696c06766 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:38.268419 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7c1e1d53-cdf7-478c-a339-984696c06766 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:38.269101 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7c1e1d53-cdf7-478c-a339-984696c06766 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:38.269533 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7c1e1d53-cdf7-478c-a339-984696c06766 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:38.334702 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-7c1e1d53-cdf7-478c-a339-984696c06766 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:38.343378 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-7c1e1d53-cdf7-478c-a339-984696c06766 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1345 microversion: 2.1 time: 0.087154 Jun 23 13:40:38.343956 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 87/181] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:38 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1345 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:38.551510 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-74228d9f-5993-428e-ab26-e8597af4a0e7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:38.552098 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-74228d9f-5993-428e-ab26-e8597af4a0e7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:38.559260 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-74228d9f-5993-428e-ab26-e8597af4a0e7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:38.559758 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-74228d9f-5993-428e-ab26-e8597af4a0e7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:38.560550 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-74228d9f-5993-428e-ab26-e8597af4a0e7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:38.560961 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-74228d9f-5993-428e-ab26-e8597af4a0e7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:38.565117 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:38.700789 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-74228d9f-5993-428e-ab26-e8597af4a0e7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:38.708567 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-74228d9f-5993-428e-ab26-e8597af4a0e7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.161110 Jun 23 13:40:38.709137 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 95/182] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:38 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:39.360054 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c90630f4-098c-4e39-88dc-bd8432cf4b2a tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:39.360673 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-c90630f4-098c-4e39-88dc-bd8432cf4b2a tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:39.367385 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c90630f4-098c-4e39-88dc-bd8432cf4b2a tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:39.367874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c90630f4-098c-4e39-88dc-bd8432cf4b2a tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:39.368660 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c90630f4-098c-4e39-88dc-bd8432cf4b2a tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:39.369087 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c90630f4-098c-4e39-88dc-bd8432cf4b2a tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:39.402806 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c90630f4-098c-4e39-88dc-bd8432cf4b2a tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:39.403486 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c90630f4-098c-4e39-88dc-bd8432cf4b2a tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:39.403931 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.objects.instance [None req-c90630f4-098c-4e39-88dc-bd8432cf4b2a tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lazy-loading 'fault' on Instance uuid 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 {{(pid=134666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:40:39.447003 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-c90630f4-098c-4e39-88dc-bd8432cf4b2a tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:39.454912 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-c90630f4-098c-4e39-88dc-bd8432cf4b2a tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1350 microversion: 2.1 time: 0.098835 Jun 23 13:40:39.463707 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 88/183] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:39 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1350 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:39.730928 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-5314b88a-da90-404b-b638-895cb9585a6a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:39.731891 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-5314b88a-da90-404b-b638-895cb9585a6a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:39.739506 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5314b88a-da90-404b-b638-895cb9585a6a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:39.740008 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5314b88a-da90-404b-b638-895cb9585a6a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:39.740856 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5314b88a-da90-404b-b638-895cb9585a6a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:39.741331 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5314b88a-da90-404b-b638-895cb9585a6a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:39.878362 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-5314b88a-da90-404b-b638-895cb9585a6a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:39.890931 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-5314b88a-da90-404b-b638-895cb9585a6a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.166754 Jun 23 13:40:39.891532 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 96/184] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:39 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:40.474954 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-1e41e148-63de-47dd-9cc6-2da4aa119130 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:40.475624 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-1e41e148-63de-47dd-9cc6-2da4aa119130 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:40.483792 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1e41e148-63de-47dd-9cc6-2da4aa119130 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:40.484237 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1e41e148-63de-47dd-9cc6-2da4aa119130 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:40.484989 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1e41e148-63de-47dd-9cc6-2da4aa119130 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:40.485409 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1e41e148-63de-47dd-9cc6-2da4aa119130 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:40.517690 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1e41e148-63de-47dd-9cc6-2da4aa119130 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:40.518139 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1e41e148-63de-47dd-9cc6-2da4aa119130 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:40.518590 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.objects.instance [None req-1e41e148-63de-47dd-9cc6-2da4aa119130 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lazy-loading 'fault' on Instance uuid 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 {{(pid=134666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:40:40.559199 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-1e41e148-63de-47dd-9cc6-2da4aa119130 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:40.567797 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-1e41e148-63de-47dd-9cc6-2da4aa119130 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1350 microversion: 2.1 time: 0.097707 Jun 23 13:40:40.568384 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 89/185] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:40 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:40.918322 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-ebb77c5e-025b-4086-8029-ab4789a8a250 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:40.919177 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-ebb77c5e-025b-4086-8029-ab4789a8a250 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:40.930693 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ebb77c5e-025b-4086-8029-ab4789a8a250 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:40.931401 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ebb77c5e-025b-4086-8029-ab4789a8a250 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:40.932584 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ebb77c5e-025b-4086-8029-ab4789a8a250 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:40.933235 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ebb77c5e-025b-4086-8029-ab4789a8a250 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:41.074226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-ebb77c5e-025b-4086-8029-ab4789a8a250 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:41.082011 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-ebb77c5e-025b-4086-8029-ab4789a8a250 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.169997 Jun 23 13:40:41.082675 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 97/186] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:40 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:41.584754 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-be51b67e-7325-44ed-82f5-3bb40d59663c tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:41.585364 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-be51b67e-7325-44ed-82f5-3bb40d59663c tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:41.592172 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-be51b67e-7325-44ed-82f5-3bb40d59663c tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:41.592618 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-be51b67e-7325-44ed-82f5-3bb40d59663c tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:41.593369 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-be51b67e-7325-44ed-82f5-3bb40d59663c tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:41.593805 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-be51b67e-7325-44ed-82f5-3bb40d59663c tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:41.612750 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:41.627271 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-be51b67e-7325-44ed-82f5-3bb40d59663c tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:41.627766 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-be51b67e-7325-44ed-82f5-3bb40d59663c tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:41.628249 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.objects.instance [None req-be51b67e-7325-44ed-82f5-3bb40d59663c tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lazy-loading 'fault' on Instance uuid 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 {{(pid=134666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:40:41.672785 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-be51b67e-7325-44ed-82f5-3bb40d59663c tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd503b205ca214601a119535611899e95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4aa13d65ad43b1849bad5bfa99e459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:41.680842 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-be51b67e-7325-44ed-82f5-3bb40d59663c tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 200 len: 1350 microversion: 2.1 time: 0.099996 Jun 23 13:40:41.681430 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 90/187] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:41 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 1350 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:42.100781 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-42a8026f-10b2-4a6f-87a4-50bd06afc382 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:42.101477 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-42a8026f-10b2-4a6f-87a4-50bd06afc382 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:42.108430 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-42a8026f-10b2-4a6f-87a4-50bd06afc382 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:42.108901 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-42a8026f-10b2-4a6f-87a4-50bd06afc382 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:42.109741 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-42a8026f-10b2-4a6f-87a4-50bd06afc382 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:42.110181 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-42a8026f-10b2-4a6f-87a4-50bd06afc382 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:42.256706 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-42a8026f-10b2-4a6f-87a4-50bd06afc382 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:42.264592 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-42a8026f-10b2-4a6f-87a4-50bd06afc382 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.168411 Jun 23 13:40:42.265164 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 98/188] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:42 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:42.697885 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-ae2c373f-4ade-4daf-acd7-ffd565288531 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:42.698581 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-ae2c373f-4ade-4daf-acd7-ffd565288531 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:42.712310 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ae2c373f-4ade-4daf-acd7-ffd565288531 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:42.712773 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ae2c373f-4ade-4daf-acd7-ffd565288531 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:42.713543 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ae2c373f-4ade-4daf-acd7-ffd565288531 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:42.713972 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ae2c373f-4ade-4daf-acd7-ffd565288531 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:42.727673 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.wsgi [None req-ae2c373f-4ade-4daf-acd7-ffd565288531 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] HTTP exception thrown: Instance 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 could not be found. Jun 23 13:40:42.732442 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-ae2c373f-4ade-4daf-acd7-ffd565288531 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Request method failure captured: Jun 23 13:40:42.732442 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: request: GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 HTTP/1.1 Jun 23 13:40:42.732442 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept: application/json Jun 23 13:40:42.732442 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept-Encoding: identity Jun 23 13:40:42.732442 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Connection: close Jun 23 13:40:42.732442 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Length: 0 Jun 23 13:40:42.732442 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Type: application/json Jun 23 13:40:42.732442 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Host: 10.222.0.26 Jun 23 13:40:42.732442 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Openstack-System-Scope: None Jun 23 13:40:42.732442 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: User-Agent: python-urllib3/1.26.9 Jun 23 13:40:42.732442 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Auth-Token: gAAAAABitG0UkfhkfmXvp7wjoe4Ig6JG499_PPQVPiMcmujFp8UoPcv7LC9gDyZMlId3jRf02mXH-djlBj668XU_VrUK_DTQxBQkv50fVxz5F7giyDRdXXkEn15w7aMS-NPGlDy0qYeWogqWrdriERmCob2a-MMZBbfYO71SBFyiJ9lnIPZVcTE Jun 23 13:40:42.732442 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Id: None Jun 23 13:40:42.732442 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Name: None Jun 23 13:40:42.732442 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Identity-Status: Confirmed Jun 23 13:40:42.732442 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Is-Admin-Project: True Jun 23 13:40:42.732442 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Id: default Jun 23 13:40:42.732442 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Name: Default Jun 23 13:40:42.732442 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Id: 8e4aa13d65ad43b1849bad5bfa99e459 Jun 23 13:40:42.732442 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Name: tempest-DeleteServersTestJSON-1832131464 Jun 23 13:40:42.732442 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Role: member,reader Jun 23 13:40:42.732442 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Roles: member,reader Jun 23 13:40:42.733948 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8e4aa13d65ad43b1849bad5bfa99e459"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e4aa13d65ad43b1849bad5bfa99e459"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e4aa13d65ad43b1849bad5bfa99e459"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8e4aa13d65ad43b1849bad5bfa99e459", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:40:42.733948 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant: tempest-DeleteServersTestJSON-1832131464 Jun 23 13:40:42.733948 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Id: 8e4aa13d65ad43b1849bad5bfa99e459 Jun 23 13:40:42.733948 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Name: tempest-DeleteServersTestJSON-1832131464 Jun 23 13:40:42.733948 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User: tempest-DeleteServersTestJSON-1832131464-project Jun 23 13:40:42.733948 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Id: default Jun 23 13:40:42.733948 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Name: Default Jun 23 13:40:42.733948 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Id: d503b205ca214601a119535611899e95 Jun 23 13:40:42.733948 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Name: tempest-DeleteServersTestJSON-1832131464-project Jun 23 13:40:42.733948 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: method: > Jun 23 13:40:42.733948 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: exception: Instance 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 could not be found. Jun 23 13:40:42.733948 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: action_args: {'id': '8e1bdfeb-cac1-45d2-9708-ac7386c20fe4'} Jun 23 13:40:42.734714 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:40:42.734714 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:40:42.734714 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:40:42.734714 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:40:42.734714 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:40:42.734714 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:40:42.734714 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:40:42.734714 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:40:42.734714 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:40:42.734714 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:40:42.734714 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 could not be found. Jun 23 13:40:42.734714 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:40:42.734714 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:40:42.734714 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:40:42.734714 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:40:42.734714 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:40:42.734714 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:40:42.734714 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:40:42.734714 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:40:42.734714 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:40:42.735931 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:40:42.735931 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:40:42.735931 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:40:42.735931 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:40:42.735931 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:40:42.735931 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:40:42.735931 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:40:42.735931 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 could not be found. Jun 23 13:40:42.735931 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:40:42.735931 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:40:42.735931 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:40:42.735931 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:40:42.735931 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:40:42.735931 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:40:42.735931 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:40:42.735931 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:40:42.735931 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 could not be found. Jun 23 13:40:42.735931 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:40:42.736909 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-ae2c373f-4ade-4daf-acd7-ffd565288531 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Returning 404 to user: Instance 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 could not be found. {{(pid=134666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:40:42.736909 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-ae2c373f-4ade-4daf-acd7-ffd565288531 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 404 len: 111 microversion: 2.1 time: 0.039860 Jun 23 13:40:42.736909 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 91/189] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:42 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:40:42.874344 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-038711c5-e0d8-44aa-98fe-b2e534d15684 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:42.875205 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-038711c5-e0d8-44aa-98fe-b2e534d15684 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:42.881957 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-038711c5-e0d8-44aa-98fe-b2e534d15684 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:42.882455 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-038711c5-e0d8-44aa-98fe-b2e534d15684 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:42.883281 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-038711c5-e0d8-44aa-98fe-b2e534d15684 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:42.883749 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-038711c5-e0d8-44aa-98fe-b2e534d15684 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:42.896987 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.wsgi [None req-038711c5-e0d8-44aa-98fe-b2e534d15684 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] HTTP exception thrown: Instance 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 could not be found. Jun 23 13:40:42.901548 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-038711c5-e0d8-44aa-98fe-b2e534d15684 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Request method failure captured: Jun 23 13:40:42.901548 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4/os-volume_attachments HTTP/1.1 Jun 23 13:40:42.901548 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:40:42.901548 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:40:42.901548 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:40:42.901548 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 0 Jun 23 13:40:42.901548 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:40:42.901548 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:40:42.901548 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:40:42.901548 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:40:42.901548 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitG0UkfhkfmXvp7wjoe4Ig6JG499_PPQVPiMcmujFp8UoPcv7LC9gDyZMlId3jRf02mXH-djlBj668XU_VrUK_DTQxBQkv50fVxz5F7giyDRdXXkEn15w7aMS-NPGlDy0qYeWogqWrdriERmCob2a-MMZBbfYO71SBFyiJ9lnIPZVcTE Jun 23 13:40:42.901548 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:40:42.901548 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:40:42.901548 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:40:42.901548 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:40:42.901548 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:40:42.901548 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:40:42.901548 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: 8e4aa13d65ad43b1849bad5bfa99e459 Jun 23 13:40:42.901548 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-DeleteServersTestJSON-1832131464 Jun 23 13:40:42.901548 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:40:42.901548 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:40:42.902936 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8e4aa13d65ad43b1849bad5bfa99e459"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e4aa13d65ad43b1849bad5bfa99e459"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e4aa13d65ad43b1849bad5bfa99e459"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8e4aa13d65ad43b1849bad5bfa99e459", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:40:42.902936 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-DeleteServersTestJSON-1832131464 Jun 23 13:40:42.902936 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: 8e4aa13d65ad43b1849bad5bfa99e459 Jun 23 13:40:42.902936 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-DeleteServersTestJSON-1832131464 Jun 23 13:40:42.902936 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-DeleteServersTestJSON-1832131464-project Jun 23 13:40:42.902936 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:40:42.902936 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:40:42.902936 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: d503b205ca214601a119535611899e95 Jun 23 13:40:42.902936 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-DeleteServersTestJSON-1832131464-project Jun 23 13:40:42.902936 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: > Jun 23 13:40:42.902936 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Instance 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 could not be found. Jun 23 13:40:42.902936 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'server_id': '8e1bdfeb-cac1-45d2-9708-ac7386c20fe4'} Jun 23 13:40:42.903747 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:40:42.903747 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:40:42.903747 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:40:42.903747 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:40:42.903747 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:40:42.903747 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:40:42.903747 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:40:42.903747 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:40:42.903747 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:40:42.903747 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:40:42.903747 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 could not be found. Jun 23 13:40:42.903747 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:40:42.903747 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:40:42.903747 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:40:42.903747 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:40:42.903747 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:40:42.903747 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:40:42.903747 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:40:42.903747 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:40:42.903747 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:40:42.905035 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:40:42.905035 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 23 13:40:42.905035 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 13:40:42.905035 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 23 13:40:42.905035 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 13:40:42.905035 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 23 13:40:42.905035 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 23 13:40:42.905035 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:40:42.905035 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:40:42.905035 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 could not be found. Jun 23 13:40:42.905035 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:40:42.905035 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:40:42.905035 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:40:42.905035 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:40:42.905035 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:40:42.905035 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:40:42.905035 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:40:42.905035 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:40:42.905035 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 could not be found. Jun 23 13:40:42.905035 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:40:42.906287 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-038711c5-e0d8-44aa-98fe-b2e534d15684 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Returning 404 to user: Instance 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 could not be found. {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:40:42.906287 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-038711c5-e0d8-44aa-98fe-b2e534d15684 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033163 Jun 23 13:40:42.906287 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 99/190] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Jun 23 13:40:42 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:40:43.281845 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-ebba5b9c-b97c-4cd7-a9a5-3b6e27d84521 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:43.282475 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-ebba5b9c-b97c-4cd7-a9a5-3b6e27d84521 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:43.288715 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ebba5b9c-b97c-4cd7-a9a5-3b6e27d84521 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:43.289175 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ebba5b9c-b97c-4cd7-a9a5-3b6e27d84521 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:43.290039 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ebba5b9c-b97c-4cd7-a9a5-3b6e27d84521 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:43.290670 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ebba5b9c-b97c-4cd7-a9a5-3b6e27d84521 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:43.429581 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-ebba5b9c-b97c-4cd7-a9a5-3b6e27d84521 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:43.437671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-ebba5b9c-b97c-4cd7-a9a5-3b6e27d84521 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.159583 Jun 23 13:40:43.438038 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 92/191] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:43 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:44.117405 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-a3240715-84ca-4261-82c0-a457a7a90536 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:44.117947 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-a3240715-84ca-4261-82c0-a457a7a90536 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:44.127025 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a3240715-84ca-4261-82c0-a457a7a90536 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:44.127605 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a3240715-84ca-4261-82c0-a457a7a90536 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:44.128483 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a3240715-84ca-4261-82c0-a457a7a90536 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:44.129685 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a3240715-84ca-4261-82c0-a457a7a90536 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:44.151517 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.wsgi [None req-a3240715-84ca-4261-82c0-a457a7a90536 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] HTTP exception thrown: Instance 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 could not be found. Jun 23 13:40:44.153764 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-a3240715-84ca-4261-82c0-a457a7a90536 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Request method failure captured: Jun 23 13:40:44.153764 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: DELETE /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 HTTP/1.1 Jun 23 13:40:44.153764 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:40:44.153764 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:40:44.153764 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:40:44.153764 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 0 Jun 23 13:40:44.153764 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:40:44.153764 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:40:44.153764 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:40:44.153764 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:40:44.153764 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitG0UkfhkfmXvp7wjoe4Ig6JG499_PPQVPiMcmujFp8UoPcv7LC9gDyZMlId3jRf02mXH-djlBj668XU_VrUK_DTQxBQkv50fVxz5F7giyDRdXXkEn15w7aMS-NPGlDy0qYeWogqWrdriERmCob2a-MMZBbfYO71SBFyiJ9lnIPZVcTE Jun 23 13:40:44.153764 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:40:44.153764 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:40:44.153764 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:40:44.153764 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:40:44.153764 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:40:44.153764 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:40:44.153764 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: 8e4aa13d65ad43b1849bad5bfa99e459 Jun 23 13:40:44.153764 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-DeleteServersTestJSON-1832131464 Jun 23 13:40:44.153764 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:40:44.153764 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:40:44.155071 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8e4aa13d65ad43b1849bad5bfa99e459"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e4aa13d65ad43b1849bad5bfa99e459"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e4aa13d65ad43b1849bad5bfa99e459"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8e4aa13d65ad43b1849bad5bfa99e459", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:40:44.155071 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-DeleteServersTestJSON-1832131464 Jun 23 13:40:44.155071 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: 8e4aa13d65ad43b1849bad5bfa99e459 Jun 23 13:40:44.155071 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-DeleteServersTestJSON-1832131464 Jun 23 13:40:44.155071 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-DeleteServersTestJSON-1832131464-project Jun 23 13:40:44.155071 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:40:44.155071 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:40:44.155071 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: d503b205ca214601a119535611899e95 Jun 23 13:40:44.155071 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-DeleteServersTestJSON-1832131464-project Jun 23 13:40:44.155071 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: > Jun 23 13:40:44.155071 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Instance 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 could not be found. Jun 23 13:40:44.155071 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'id': '8e1bdfeb-cac1-45d2-9708-ac7386c20fe4'} Jun 23 13:40:44.156226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:40:44.156226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:40:44.156226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:40:44.156226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:40:44.156226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:40:44.156226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:40:44.156226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:40:44.156226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:40:44.156226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:40:44.156226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:40:44.156226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 could not be found. Jun 23 13:40:44.156226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:40:44.156226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:40:44.156226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:40:44.156226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:40:44.156226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:40:44.156226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:40:44.156226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:40:44.156226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:40:44.156226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:40:44.157652 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:40:44.157652 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 13:40:44.157652 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 13:40:44.157652 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 13:40:44.157652 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 13:40:44.157652 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:40:44.157652 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:40:44.157652 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:40:44.157652 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:40:44.157652 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 could not be found. Jun 23 13:40:44.157652 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:40:44.157652 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:40:44.157652 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:40:44.157652 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:40:44.157652 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:40:44.157652 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:40:44.157652 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:40:44.157652 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:40:44.157652 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 could not be found. Jun 23 13:40:44.157652 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:40:44.159164 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-a3240715-84ca-4261-82c0-a457a7a90536 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Returning 404 to user: Instance 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 could not be found. {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:40:44.159164 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-a3240715-84ca-4261-82c0-a457a7a90536 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 404 len: 111 microversion: 2.1 time: 0.042134 Jun 23 13:40:44.159535 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 100/192] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Jun 23 13:40:44 2022] DELETE /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:40:44.164567 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-383fb393-dcf4-496a-928d-e8b9e54b7dc6 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:44.165424 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-383fb393-dcf4-496a-928d-e8b9e54b7dc6 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] [instance: 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:44.172481 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-383fb393-dcf4-496a-928d-e8b9e54b7dc6 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:44.172938 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-383fb393-dcf4-496a-928d-e8b9e54b7dc6 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:44.173772 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-383fb393-dcf4-496a-928d-e8b9e54b7dc6 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:44.174255 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-383fb393-dcf4-496a-928d-e8b9e54b7dc6 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:44.190908 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.wsgi [None req-383fb393-dcf4-496a-928d-e8b9e54b7dc6 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] HTTP exception thrown: Instance 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 could not be found. Jun 23 13:40:44.192671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-383fb393-dcf4-496a-928d-e8b9e54b7dc6 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Request method failure captured: Jun 23 13:40:44.192671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: request: GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 HTTP/1.1 Jun 23 13:40:44.192671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept: application/json Jun 23 13:40:44.192671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept-Encoding: identity Jun 23 13:40:44.192671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Connection: close Jun 23 13:40:44.192671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Length: 0 Jun 23 13:40:44.192671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Type: application/json Jun 23 13:40:44.192671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Host: 10.222.0.26 Jun 23 13:40:44.192671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Openstack-System-Scope: None Jun 23 13:40:44.192671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: User-Agent: python-urllib3/1.26.9 Jun 23 13:40:44.192671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Auth-Token: gAAAAABitG0UkfhkfmXvp7wjoe4Ig6JG499_PPQVPiMcmujFp8UoPcv7LC9gDyZMlId3jRf02mXH-djlBj668XU_VrUK_DTQxBQkv50fVxz5F7giyDRdXXkEn15w7aMS-NPGlDy0qYeWogqWrdriERmCob2a-MMZBbfYO71SBFyiJ9lnIPZVcTE Jun 23 13:40:44.192671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Id: None Jun 23 13:40:44.192671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Name: None Jun 23 13:40:44.192671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Identity-Status: Confirmed Jun 23 13:40:44.192671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Is-Admin-Project: True Jun 23 13:40:44.192671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Id: default Jun 23 13:40:44.192671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Name: Default Jun 23 13:40:44.192671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Id: 8e4aa13d65ad43b1849bad5bfa99e459 Jun 23 13:40:44.192671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Name: tempest-DeleteServersTestJSON-1832131464 Jun 23 13:40:44.192671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Role: member,reader Jun 23 13:40:44.192671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Roles: member,reader Jun 23 13:40:44.194075 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8e4aa13d65ad43b1849bad5bfa99e459"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e4aa13d65ad43b1849bad5bfa99e459"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8e4aa13d65ad43b1849bad5bfa99e459"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8e4aa13d65ad43b1849bad5bfa99e459", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:40:44.194075 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant: tempest-DeleteServersTestJSON-1832131464 Jun 23 13:40:44.194075 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Id: 8e4aa13d65ad43b1849bad5bfa99e459 Jun 23 13:40:44.194075 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Name: tempest-DeleteServersTestJSON-1832131464 Jun 23 13:40:44.194075 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User: tempest-DeleteServersTestJSON-1832131464-project Jun 23 13:40:44.194075 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Id: default Jun 23 13:40:44.194075 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Name: Default Jun 23 13:40:44.194075 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Id: d503b205ca214601a119535611899e95 Jun 23 13:40:44.194075 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Name: tempest-DeleteServersTestJSON-1832131464-project Jun 23 13:40:44.194075 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: method: > Jun 23 13:40:44.194075 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: exception: Instance 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 could not be found. Jun 23 13:40:44.194075 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: action_args: {'id': '8e1bdfeb-cac1-45d2-9708-ac7386c20fe4'} Jun 23 13:40:44.194874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:40:44.194874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:40:44.194874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:40:44.194874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:40:44.194874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:40:44.194874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:40:44.194874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:40:44.194874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:40:44.194874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:40:44.194874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:40:44.194874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 could not be found. Jun 23 13:40:44.194874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:40:44.194874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:40:44.194874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:40:44.194874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:40:44.194874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:40:44.194874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:40:44.194874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:40:44.194874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:40:44.194874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:40:44.196213 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:40:44.196213 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:40:44.196213 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:40:44.196213 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:40:44.196213 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:40:44.196213 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:40:44.196213 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:40:44.196213 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 could not be found. Jun 23 13:40:44.196213 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:40:44.196213 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:40:44.196213 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:40:44.196213 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:40:44.196213 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:40:44.196213 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:40:44.196213 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:40:44.196213 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:40:44.196213 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 could not be found. Jun 23 13:40:44.196213 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:40:44.197308 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-383fb393-dcf4-496a-928d-e8b9e54b7dc6 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] Returning 404 to user: Instance 8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 could not be found. {{(pid=134666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:40:44.197308 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-383fb393-dcf4-496a-928d-e8b9e54b7dc6 tempest-DeleteServersTestJSON-1832131464 tempest-DeleteServersTestJSON-1832131464-project] 10.222.0.26 "GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4" status: 404 len: 111 microversion: 2.1 time: 0.033684 Jun 23 13:40:44.197308 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 93/193] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:44 2022] GET /compute/v2.1/servers/8e1bdfeb-cac1-45d2-9708-ac7386c20fe4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 13:40:44.454843 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-3f979360-d366-46b8-99cf-652a81230568 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:44.455546 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-3f979360-d366-46b8-99cf-652a81230568 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:44.462379 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3f979360-d366-46b8-99cf-652a81230568 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:44.462883 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3f979360-d366-46b8-99cf-652a81230568 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:44.463797 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3f979360-d366-46b8-99cf-652a81230568 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:44.464247 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3f979360-d366-46b8-99cf-652a81230568 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:44.602335 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-3f979360-d366-46b8-99cf-652a81230568 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:44.610516 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-3f979360-d366-46b8-99cf-652a81230568 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.159586 Jun 23 13:40:44.620464 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 101/194] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:44 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:45.628300 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-52ed71de-38e0-44d3-a0e7-902b0c10ec95 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:45.629016 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-52ed71de-38e0-44d3-a0e7-902b0c10ec95 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:45.636184 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-52ed71de-38e0-44d3-a0e7-902b0c10ec95 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:45.636637 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-52ed71de-38e0-44d3-a0e7-902b0c10ec95 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:45.637419 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-52ed71de-38e0-44d3-a0e7-902b0c10ec95 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:45.637856 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-52ed71de-38e0-44d3-a0e7-902b0c10ec95 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:45.774174 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-52ed71de-38e0-44d3-a0e7-902b0c10ec95 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:45.788166 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-52ed71de-38e0-44d3-a0e7-902b0c10ec95 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.163646 Jun 23 13:40:45.788858 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 94/195] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:45 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:46.805895 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-f3e9ee14-951e-4c89-ad89-309ddaaa99a6 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:46.806529 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-f3e9ee14-951e-4c89-ad89-309ddaaa99a6 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:46.809125 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_api:SELECT=48 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:46.814295 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f3e9ee14-951e-4c89-ad89-309ddaaa99a6 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:46.814796 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f3e9ee14-951e-4c89-ad89-309ddaaa99a6 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:46.815690 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f3e9ee14-951e-4c89-ad89-309ddaaa99a6 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:46.816138 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f3e9ee14-951e-4c89-ad89-309ddaaa99a6 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:46.986445 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-f3e9ee14-951e-4c89-ad89-309ddaaa99a6 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:46.994838 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-f3e9ee14-951e-4c89-ad89-309ddaaa99a6 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.192982 Jun 23 13:40:46.995439 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 102/196] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:46 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:48.012710 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-7246de03-2344-4689-9f55-1bcd689b383a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:48.013307 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-7246de03-2344-4689-9f55-1bcd689b383a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:48.022681 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7246de03-2344-4689-9f55-1bcd689b383a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:48.023525 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7246de03-2344-4689-9f55-1bcd689b383a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:48.024615 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7246de03-2344-4689-9f55-1bcd689b383a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:48.025475 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7246de03-2344-4689-9f55-1bcd689b383a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:48.170760 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-7246de03-2344-4689-9f55-1bcd689b383a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:48.179165 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-7246de03-2344-4689-9f55-1bcd689b383a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.170913 Jun 23 13:40:48.179910 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 95/197] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:48 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:49.196754 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-42a8d945-b339-44e7-937b-04f3dd4a138d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:49.197498 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-42a8d945-b339-44e7-937b-04f3dd4a138d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:49.212726 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-42a8d945-b339-44e7-937b-04f3dd4a138d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:49.213147 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-42a8d945-b339-44e7-937b-04f3dd4a138d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:49.213921 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-42a8d945-b339-44e7-937b-04f3dd4a138d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:49.214347 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-42a8d945-b339-44e7-937b-04f3dd4a138d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:49.358561 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-42a8d945-b339-44e7-937b-04f3dd4a138d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:49.372978 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-42a8d945-b339-44e7-937b-04f3dd4a138d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.180154 Jun 23 13:40:49.373591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 103/198] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:49 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:50.393999 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-dcd92995-3502-4653-b5e6-fff1a05661ff tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:50.395002 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-dcd92995-3502-4653-b5e6-fff1a05661ff tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:50.405251 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-dcd92995-3502-4653-b5e6-fff1a05661ff tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:50.405989 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-dcd92995-3502-4653-b5e6-fff1a05661ff tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:50.407230 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-dcd92995-3502-4653-b5e6-fff1a05661ff tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:50.408004 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-dcd92995-3502-4653-b5e6-fff1a05661ff tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:50.546979 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-dcd92995-3502-4653-b5e6-fff1a05661ff tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:50.558795 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-dcd92995-3502-4653-b5e6-fff1a05661ff tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.170960 Jun 23 13:40:50.559627 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 96/199] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:50 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:51.577636 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-09a9e95e-9ff0-4698-ab12-bc603a953586 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:51.578205 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-09a9e95e-9ff0-4698-ab12-bc603a953586 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:51.585810 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-09a9e95e-9ff0-4698-ab12-bc603a953586 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:51.586238 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-09a9e95e-9ff0-4698-ab12-bc603a953586 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:51.587033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-09a9e95e-9ff0-4698-ab12-bc603a953586 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:51.587538 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-09a9e95e-9ff0-4698-ab12-bc603a953586 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:51.717898 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-09a9e95e-9ff0-4698-ab12-bc603a953586 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:51.729285 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-09a9e95e-9ff0-4698-ab12-bc603a953586 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.155280 Jun 23 13:40:51.729985 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 104/200] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:51 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:52.746316 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-d70dd548-66c1-4c1e-aa04-3c540fc8abdd tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:52.746960 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-d70dd548-66c1-4c1e-aa04-3c540fc8abdd tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:52.753438 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d70dd548-66c1-4c1e-aa04-3c540fc8abdd tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:52.753917 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d70dd548-66c1-4c1e-aa04-3c540fc8abdd tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:52.754795 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d70dd548-66c1-4c1e-aa04-3c540fc8abdd tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:52.755283 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d70dd548-66c1-4c1e-aa04-3c540fc8abdd tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:52.897034 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-d70dd548-66c1-4c1e-aa04-3c540fc8abdd tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:52.904605 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-d70dd548-66c1-4c1e-aa04-3c540fc8abdd tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.162301 Jun 23 13:40:52.905172 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 97/201] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:52 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:53.925767 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-a9409d61-130c-4cd7-be7f-33ac59cadd51 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:53.926720 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-a9409d61-130c-4cd7-be7f-33ac59cadd51 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:53.933547 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a9409d61-130c-4cd7-be7f-33ac59cadd51 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:53.934001 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a9409d61-130c-4cd7-be7f-33ac59cadd51 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:53.934763 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a9409d61-130c-4cd7-be7f-33ac59cadd51 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:53.935198 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a9409d61-130c-4cd7-be7f-33ac59cadd51 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:54.079207 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-a9409d61-130c-4cd7-be7f-33ac59cadd51 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:54.087362 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-a9409d61-130c-4cd7-be7f-33ac59cadd51 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.168363 Jun 23 13:40:54.095448 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 105/202] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:53 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:55.109784 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-75ef0865-b5af-4368-9647-4fdd91dfbd6f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:55.110412 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-75ef0865-b5af-4368-9647-4fdd91dfbd6f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:55.112393 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:40:55.118110 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-75ef0865-b5af-4368-9647-4fdd91dfbd6f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:55.118551 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-75ef0865-b5af-4368-9647-4fdd91dfbd6f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:55.119301 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-75ef0865-b5af-4368-9647-4fdd91dfbd6f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:55.119776 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-75ef0865-b5af-4368-9647-4fdd91dfbd6f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:55.251041 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-75ef0865-b5af-4368-9647-4fdd91dfbd6f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:55.262526 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-75ef0865-b5af-4368-9647-4fdd91dfbd6f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.161882 Jun 23 13:40:55.263250 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 98/203] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:55 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:56.285698 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-5d82432e-5d31-463e-8555-488ed3058321 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:56.286494 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-5d82432e-5d31-463e-8555-488ed3058321 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:56.293634 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5d82432e-5d31-463e-8555-488ed3058321 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:56.294107 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5d82432e-5d31-463e-8555-488ed3058321 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:56.294870 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5d82432e-5d31-463e-8555-488ed3058321 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:56.295387 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5d82432e-5d31-463e-8555-488ed3058321 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:56.427731 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-5d82432e-5d31-463e-8555-488ed3058321 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:56.435561 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-5d82432e-5d31-463e-8555-488ed3058321 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.156219 Jun 23 13:40:56.436132 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 106/204] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:56 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:57.457029 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-042145ab-dd82-4475-a226-3b64abb72fa5 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:57.458039 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-042145ab-dd82-4475-a226-3b64abb72fa5 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:57.465871 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-042145ab-dd82-4475-a226-3b64abb72fa5 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:57.466403 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-042145ab-dd82-4475-a226-3b64abb72fa5 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:57.467285 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-042145ab-dd82-4475-a226-3b64abb72fa5 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:57.467842 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-042145ab-dd82-4475-a226-3b64abb72fa5 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:57.602338 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-042145ab-dd82-4475-a226-3b64abb72fa5 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:57.610172 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-042145ab-dd82-4475-a226-3b64abb72fa5 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.159631 Jun 23 13:40:57.610883 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 99/205] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:57 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:58.631766 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-6a680ed1-3e56-46ea-b391-6df2188312e0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:58.632588 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-6a680ed1-3e56-46ea-b391-6df2188312e0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:58.644651 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6a680ed1-3e56-46ea-b391-6df2188312e0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:58.645404 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6a680ed1-3e56-46ea-b391-6df2188312e0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:58.646664 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6a680ed1-3e56-46ea-b391-6df2188312e0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:58.647422 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6a680ed1-3e56-46ea-b391-6df2188312e0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:58.781521 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-6a680ed1-3e56-46ea-b391-6df2188312e0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:58.789526 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-6a680ed1-3e56-46ea-b391-6df2188312e0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.164541 Jun 23 13:40:58.790090 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 107/206] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:58 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:40:59.810246 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-47cf1f94-165e-40e0-94f4-16713fe059e7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:40:59.811201 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-47cf1f94-165e-40e0-94f4-16713fe059e7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:40:59.821420 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-47cf1f94-165e-40e0-94f4-16713fe059e7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:59.822177 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-47cf1f94-165e-40e0-94f4-16713fe059e7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:59.823498 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-47cf1f94-165e-40e0-94f4-16713fe059e7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:40:59.824215 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-47cf1f94-165e-40e0-94f4-16713fe059e7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:40:59.958634 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-47cf1f94-165e-40e0-94f4-16713fe059e7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:40:59.966606 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-47cf1f94-165e-40e0-94f4-16713fe059e7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.162834 Jun 23 13:40:59.967171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 100/207] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:40:59 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:00.983101 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-a54a3c9e-e3d6-421d-b353-a88910ad8ec3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:00.983805 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-a54a3c9e-e3d6-421d-b353-a88910ad8ec3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:00.990528 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a54a3c9e-e3d6-421d-b353-a88910ad8ec3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:00.990994 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a54a3c9e-e3d6-421d-b353-a88910ad8ec3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:00.991780 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a54a3c9e-e3d6-421d-b353-a88910ad8ec3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:00.992209 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a54a3c9e-e3d6-421d-b353-a88910ad8ec3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:01.131109 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-a54a3c9e-e3d6-421d-b353-a88910ad8ec3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:01.139157 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-a54a3c9e-e3d6-421d-b353-a88910ad8ec3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.159517 Jun 23 13:41:01.139791 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 108/208] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:00 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:02.156270 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-055ac664-3871-42fb-b457-e5f67bbf017b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:02.156831 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-055ac664-3871-42fb-b457-e5f67bbf017b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:02.163274 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-055ac664-3871-42fb-b457-e5f67bbf017b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:02.163717 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-055ac664-3871-42fb-b457-e5f67bbf017b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:02.164503 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-055ac664-3871-42fb-b457-e5f67bbf017b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:02.164929 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-055ac664-3871-42fb-b457-e5f67bbf017b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:02.307118 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-055ac664-3871-42fb-b457-e5f67bbf017b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:02.315420 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-055ac664-3871-42fb-b457-e5f67bbf017b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1520 microversion: 2.1 time: 0.163041 Jun 23 13:41:02.315912 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 101/209] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:02 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:03.333836 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-9089cf0a-f4b2-4d07-9b10-60a302afbbd6 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:03.334663 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-9089cf0a-f4b2-4d07-9b10-60a302afbbd6 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:03.343814 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9089cf0a-f4b2-4d07-9b10-60a302afbbd6 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:03.344312 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9089cf0a-f4b2-4d07-9b10-60a302afbbd6 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:03.345182 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9089cf0a-f4b2-4d07-9b10-60a302afbbd6 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:03.345637 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9089cf0a-f4b2-4d07-9b10-60a302afbbd6 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:03.534583 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-9089cf0a-f4b2-4d07-9b10-60a302afbbd6 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:03.542663 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-9089cf0a-f4b2-4d07-9b10-60a302afbbd6 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1500 microversion: 2.1 time: 0.213822 Jun 23 13:41:03.543227 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 109/210] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:03 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1500 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:03.558958 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-402ee91a-79bc-4710-b697-ed6e61b7a537 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:03.559631 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-402ee91a-79bc-4710-b697-ed6e61b7a537 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:03.566284 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-402ee91a-79bc-4710-b697-ed6e61b7a537 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:03.566795 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-402ee91a-79bc-4710-b697-ed6e61b7a537 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:03.568003 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-402ee91a-79bc-4710-b697-ed6e61b7a537 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:03.568444 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-402ee91a-79bc-4710-b697-ed6e61b7a537 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:03.721999 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-402ee91a-79bc-4710-b697-ed6e61b7a537 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:03.730546 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-402ee91a-79bc-4710-b697-ed6e61b7a537 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29" status: 200 len: 1515 microversion: 2.1 time: 0.175413 Jun 23 13:41:03.731215 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 102/211] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:03 2022] GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29 => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:05.222246 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-f82b4b48-16af-42a2-8045-dfa3e7ab1753 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:41:05.223855 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-f82b4b48-16af-42a2-8045-dfa3e7ab1753 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:05.230498 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f82b4b48-16af-42a2-8045-dfa3e7ab1753 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:05.231083 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f82b4b48-16af-42a2-8045-dfa3e7ab1753 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:05.232064 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f82b4b48-16af-42a2-8045-dfa3e7ab1753 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:05.232708 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f82b4b48-16af-42a2-8045-dfa3e7ab1753 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:05.256010 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.objects.instance [None req-f82b4b48-16af-42a2-8045-dfa3e7ab1753 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lazy-loading 'flavor' on Instance uuid ee2cdaf7-cefe-4877-b855-b4646b50cf29 {{(pid=134667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:41:05.335612 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-f82b4b48-16af-42a2-8045-dfa3e7ab1753 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "POST /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29/action" status: 200 len: 32 microversion: 2.1 time: 0.117027 Jun 23 13:41:05.336396 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 110/212] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Jun 23 13:41:05 2022] POST /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29/action => generated 32 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 13:41:05.346732 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-25fe42e2-10bc-4197-a993-5b3d0021475c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:05.347426 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-25fe42e2-10bc-4197-a993-5b3d0021475c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:05.369917 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-25fe42e2-10bc-4197-a993-5b3d0021475c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:05.370618 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-25fe42e2-10bc-4197-a993-5b3d0021475c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:05.371705 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-25fe42e2-10bc-4197-a993-5b3d0021475c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:05.373146 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-25fe42e2-10bc-4197-a993-5b3d0021475c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:05.625014 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-25fe42e2-10bc-4197-a993-5b3d0021475c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:05.639245 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-25fe42e2-10bc-4197-a993-5b3d0021475c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29" status: 200 len: 1521 microversion: 2.1 time: 0.297297 Jun 23 13:41:05.641693 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 103/213] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:05 2022] GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29 => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:41:06.659360 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-91363d11-fdb6-49cd-af80-8a94075c8648 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:06.660122 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-91363d11-fdb6-49cd-af80-8a94075c8648 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:06.668369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-91363d11-fdb6-49cd-af80-8a94075c8648 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:06.668824 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-91363d11-fdb6-49cd-af80-8a94075c8648 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:06.669603 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-91363d11-fdb6-49cd-af80-8a94075c8648 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:06.670029 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-91363d11-fdb6-49cd-af80-8a94075c8648 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:06.675048 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:06.758141 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-d3ca7519-a5a2-4cac-affc-73abb51dd3fa tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1023150252", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-150071967", "security_groups": [{"name": "tempest-secgroup-smoke-123319687"}], "networks": [{"uuid": "487c99b8-1e62-4d10-926f-f0a88401678c"}], "block_device_mapping_v2": [{"uuid": "b7e82954-9271-43ba-9e9a-7eb1fc0cb15b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:41:06.823818 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-91363d11-fdb6-49cd-af80-8a94075c8648 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:06.834244 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-91363d11-fdb6-49cd-af80-8a94075c8648 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29" status: 200 len: 1521 microversion: 2.1 time: 0.179845 Jun 23 13:41:06.834829 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 111/214] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:06 2022] GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:06.885440 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.network.neutron [None req-d3ca7519-a5a2-4cac-affc-73abb51dd3fa tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] validate_networks() for [('487c99b8-1e62-4d10-926f-f0a88401678c', None, None, None, None, None)] {{(pid=134666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 13:41:07.407328 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-d3ca7519-a5a2-4cac-affc-73abb51dd3fa tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Flavor limits 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 13:41:07.407774 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-d3ca7519-a5a2-4cac-affc-73abb51dd3fa tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Image limits 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 13:41:07.408244 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-d3ca7519-a5a2-4cac-affc-73abb51dd3fa tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Flavor pref 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 13:41:07.408711 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-d3ca7519-a5a2-4cac-affc-73abb51dd3fa tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Image pref 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 13:41:07.409115 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-d3ca7519-a5a2-4cac-affc-73abb51dd3fa tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 13:41:07.421293 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d3ca7519-a5a2-4cac-affc-73abb51dd3fa tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:07.421818 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d3ca7519-a5a2-4cac-affc-73abb51dd3fa tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:07.422706 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d3ca7519-a5a2-4cac-affc-73abb51dd3fa tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:07.423267 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d3ca7519-a5a2-4cac-affc-73abb51dd3fa tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:07.443681 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-d3ca7519-a5a2-4cac-affc-73abb51dd3fa tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Getting quotas for project b2fef8d0cb974f35a741c3090fda97f1. Resources: {'ram', 'cores', 'instances'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:41:07.448155 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-d3ca7519-a5a2-4cac-affc-73abb51dd3fa tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Getting quotas for user e7e1bce062244098888ecb72b11ccd88 and project b2fef8d0cb974f35a741c3090fda97f1. Resources: {'ram', 'cores', 'instances'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:41:07.513660 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-d3ca7519-a5a2-4cac-affc-73abb51dd3fa tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Going to run 1 instances... {{(pid=134666) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 13:41:07.515785 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-d3ca7519-a5a2-4cac-affc-73abb51dd3fa tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b7e82954-9271-43ba-9e9a-7eb1fc0cb15b',volume_size=None,volume_type=None)] {{(pid=134666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 13:41:07.674605 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-d3ca7519-a5a2-4cac-affc-73abb51dd3fa tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.919422 Jun 23 13:41:07.677126 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 104/215] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Jun 23 13:41:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 13:41:07.688388 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-35820b4f-8eb6-4d10-88de-48cba06721f0 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:07.689008 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-35820b4f-8eb6-4d10-88de-48cba06721f0 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:07.778480 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-35820b4f-8eb6-4d10-88de-48cba06721f0 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:07.787057 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-35820b4f-8eb6-4d10-88de-48cba06721f0 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1088 microversion: 2.1 time: 0.106198 Jun 23 13:41:07.796537 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 112/216] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:07 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1088 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:07.851910 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-7324bc46-c0a6-402a-8099-ad6831d3f9e3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:07.853366 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-7324bc46-c0a6-402a-8099-ad6831d3f9e3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:07.859721 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7324bc46-c0a6-402a-8099-ad6831d3f9e3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:07.861915 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7324bc46-c0a6-402a-8099-ad6831d3f9e3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:07.862713 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7324bc46-c0a6-402a-8099-ad6831d3f9e3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:07.863150 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7324bc46-c0a6-402a-8099-ad6831d3f9e3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:08.047995 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-7324bc46-c0a6-402a-8099-ad6831d3f9e3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:08.057976 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-7324bc46-c0a6-402a-8099-ad6831d3f9e3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29" status: 200 len: 1521 microversion: 2.1 time: 0.209765 Jun 23 13:41:08.059178 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 105/217] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:07 2022] GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:08.805461 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-dec25f05-4ea4-495a-8557-f10a5e892f57 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:08.806073 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-dec25f05-4ea4-495a-8557-f10a5e892f57 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:08.815270 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-dec25f05-4ea4-495a-8557-f10a5e892f57 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:08.815745 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-dec25f05-4ea4-495a-8557-f10a5e892f57 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:08.816714 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-dec25f05-4ea4-495a-8557-f10a5e892f57 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:08.817310 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-dec25f05-4ea4-495a-8557-f10a5e892f57 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:08.903066 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-dec25f05-4ea4-495a-8557-f10a5e892f57 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:08.911680 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-dec25f05-4ea4-495a-8557-f10a5e892f57 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1194 microversion: 2.1 time: 0.111758 Jun 23 13:41:08.912246 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 113/218] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:08 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1194 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:09.076931 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-f1392d92-8743-4e75-b60f-25f221d035d1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:09.077544 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-f1392d92-8743-4e75-b60f-25f221d035d1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:09.084426 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f1392d92-8743-4e75-b60f-25f221d035d1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:09.085080 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f1392d92-8743-4e75-b60f-25f221d035d1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:09.086815 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f1392d92-8743-4e75-b60f-25f221d035d1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:09.087382 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f1392d92-8743-4e75-b60f-25f221d035d1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:09.233481 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-f1392d92-8743-4e75-b60f-25f221d035d1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:09.242812 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-f1392d92-8743-4e75-b60f-25f221d035d1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29" status: 200 len: 1521 microversion: 2.1 time: 0.168322 Jun 23 13:41:09.242812 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 106/219] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:09 2022] GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:09.942994 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-eaa4a121-2d7e-43fd-93fd-064ab3445b4e tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:09.946923 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-eaa4a121-2d7e-43fd-93fd-064ab3445b4e tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:09.970288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-eaa4a121-2d7e-43fd-93fd-064ab3445b4e tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:09.970801 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-eaa4a121-2d7e-43fd-93fd-064ab3445b4e tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:09.972242 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-eaa4a121-2d7e-43fd-93fd-064ab3445b4e tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:09.972850 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-eaa4a121-2d7e-43fd-93fd-064ab3445b4e tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:10.228079 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-eaa4a121-2d7e-43fd-93fd-064ab3445b4e tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:10.236675 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-eaa4a121-2d7e-43fd-93fd-064ab3445b4e tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1271 microversion: 2.1 time: 0.311268 Jun 23 13:41:10.237441 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 114/220] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:09 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1271 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:10.259561 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-3cd46188-e2d8-4faf-b109-377ba50764dc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:10.261112 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-3cd46188-e2d8-4faf-b109-377ba50764dc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:10.271295 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3cd46188-e2d8-4faf-b109-377ba50764dc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:10.272504 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3cd46188-e2d8-4faf-b109-377ba50764dc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:10.273982 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3cd46188-e2d8-4faf-b109-377ba50764dc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:10.274838 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3cd46188-e2d8-4faf-b109-377ba50764dc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:10.434605 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-3cd46188-e2d8-4faf-b109-377ba50764dc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:10.444133 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-3cd46188-e2d8-4faf-b109-377ba50764dc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29" status: 200 len: 1521 microversion: 2.1 time: 0.189348 Jun 23 13:41:10.445338 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 107/221] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:10 2022] GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:10.796365 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-b1a69525-2a00-4595-91f6-b2e32ace2b17 req-cb371ef2-fbd5-4359-bf3f-dd34e2a44a32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89a0e254-8280-4e56-80e6-525cca5dcac3", "tag": "c680d421-4232-46b9-bea8-b492d2e2f651"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:41:10.832948 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-b1a69525-2a00-4595-91f6-b2e32ace2b17 req-cb371ef2-fbd5-4359-bf3f-dd34e2a44a32 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:10.835469 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-b1a69525-2a00-4595-91f6-b2e32ace2b17 req-cb371ef2-fbd5-4359-bf3f-dd34e2a44a32 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:10.850134 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-b1a69525-2a00-4595-91f6-b2e32ace2b17 req-cb371ef2-fbd5-4359-bf3f-dd34e2a44a32 service nova] Creating event network-changed:c680d421-4232-46b9-bea8-b492d2e2f651 for instance 89a0e254-8280-4e56-80e6-525cca5dcac3 on hv-cinder-81558 Jun 23 13:41:10.854303 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-b1a69525-2a00-4595-91f6-b2e32ace2b17 req-cb371ef2-fbd5-4359-bf3f-dd34e2a44a32 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071265 Jun 23 13:41:10.854822 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 115/222] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:41:11.255396 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-abeecca5-ce82-48a7-9fed-a96d0cf9fef5 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:11.256304 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-abeecca5-ce82-48a7-9fed-a96d0cf9fef5 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:11.263543 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-abeecca5-ce82-48a7-9fed-a96d0cf9fef5 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:11.264121 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-abeecca5-ce82-48a7-9fed-a96d0cf9fef5 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:11.264751 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-abeecca5-ce82-48a7-9fed-a96d0cf9fef5 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:11.265195 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-abeecca5-ce82-48a7-9fed-a96d0cf9fef5 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:11.401389 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-abeecca5-ce82-48a7-9fed-a96d0cf9fef5 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:11.405026 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:SELECT=100 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:11.410307 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-abeecca5-ce82-48a7-9fed-a96d0cf9fef5 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1259 microversion: 2.1 time: 0.159658 Jun 23 13:41:11.410955 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 108/223] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:11 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:11.463503 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-698eee75-a29d-495a-b170-d68f805acb2e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:11.464847 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-698eee75-a29d-495a-b170-d68f805acb2e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:11.471446 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-698eee75-a29d-495a-b170-d68f805acb2e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:11.471898 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-698eee75-a29d-495a-b170-d68f805acb2e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:11.472712 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-698eee75-a29d-495a-b170-d68f805acb2e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:11.473156 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-698eee75-a29d-495a-b170-d68f805acb2e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:11.610016 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-698eee75-a29d-495a-b170-d68f805acb2e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:11.619041 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-698eee75-a29d-495a-b170-d68f805acb2e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29" status: 200 len: 1521 microversion: 2.1 time: 0.160395 Jun 23 13:41:11.619682 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 116/224] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:11 2022] GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:41:12.426560 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-1c340a75-0ba7-433c-a8db-efe2faaa2b4c tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:12.427812 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-1c340a75-0ba7-433c-a8db-efe2faaa2b4c tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:12.434340 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1c340a75-0ba7-433c-a8db-efe2faaa2b4c tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:12.435053 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1c340a75-0ba7-433c-a8db-efe2faaa2b4c tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:12.436668 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1c340a75-0ba7-433c-a8db-efe2faaa2b4c tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:12.437353 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1c340a75-0ba7-433c-a8db-efe2faaa2b4c tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:12.583498 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-1c340a75-0ba7-433c-a8db-efe2faaa2b4c tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:12.591163 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-1c340a75-0ba7-433c-a8db-efe2faaa2b4c tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1259 microversion: 2.1 time: 0.168253 Jun 23 13:41:12.591797 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 109/225] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:12 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:12.635550 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-c87d06cf-e663-4f57-817b-2f4e8e093771 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:12.636772 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-c87d06cf-e663-4f57-817b-2f4e8e093771 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:12.643533 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c87d06cf-e663-4f57-817b-2f4e8e093771 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:12.644029 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c87d06cf-e663-4f57-817b-2f4e8e093771 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:12.644905 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c87d06cf-e663-4f57-817b-2f4e8e093771 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:12.645336 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c87d06cf-e663-4f57-817b-2f4e8e093771 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:12.947759 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-c87d06cf-e663-4f57-817b-2f4e8e093771 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:12.957170 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-c87d06cf-e663-4f57-817b-2f4e8e093771 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29" status: 200 len: 1521 microversion: 2.1 time: 0.325199 Jun 23 13:41:12.957958 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 117/226] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:12 2022] GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29 => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:13.611094 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-851ce8b0-e9a6-4ad5-ac6c-86ff99d74789 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:13.612398 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-851ce8b0-e9a6-4ad5-ac6c-86ff99d74789 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:13.622938 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-851ce8b0-e9a6-4ad5-ac6c-86ff99d74789 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:13.623933 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-851ce8b0-e9a6-4ad5-ac6c-86ff99d74789 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:13.625271 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-851ce8b0-e9a6-4ad5-ac6c-86ff99d74789 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:13.625817 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-851ce8b0-e9a6-4ad5-ac6c-86ff99d74789 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:13.864082 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-851ce8b0-e9a6-4ad5-ac6c-86ff99d74789 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:13.871798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-851ce8b0-e9a6-4ad5-ac6c-86ff99d74789 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1259 microversion: 2.1 time: 0.267635 Jun 23 13:41:13.872863 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 110/227] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:13 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1259 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:41:13.975634 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-7c2eb004-315d-4083-b75a-835c9b9a3470 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:13.976809 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-7c2eb004-315d-4083-b75a-835c9b9a3470 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:13.983973 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7c2eb004-315d-4083-b75a-835c9b9a3470 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:13.984711 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7c2eb004-315d-4083-b75a-835c9b9a3470 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:13.985779 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7c2eb004-315d-4083-b75a-835c9b9a3470 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:13.986430 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7c2eb004-315d-4083-b75a-835c9b9a3470 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:14.262656 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-7c2eb004-315d-4083-b75a-835c9b9a3470 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:14.278919 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-7c2eb004-315d-4083-b75a-835c9b9a3470 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29" status: 200 len: 1521 microversion: 2.1 time: 0.306535 Jun 23 13:41:14.279753 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 118/228] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:13 2022] GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:14.892099 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-b89fc291-9b7e-451a-b003-7073affbce71 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:14.892651 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-b89fc291-9b7e-451a-b003-7073affbce71 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:14.904850 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b89fc291-9b7e-451a-b003-7073affbce71 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:14.905325 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b89fc291-9b7e-451a-b003-7073affbce71 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:14.906105 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b89fc291-9b7e-451a-b003-7073affbce71 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:14.906537 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b89fc291-9b7e-451a-b003-7073affbce71 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:15.107712 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-b89fc291-9b7e-451a-b003-7073affbce71 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:15.122874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-b89fc291-9b7e-451a-b003-7073affbce71 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1259 microversion: 2.1 time: 0.235131 Jun 23 13:41:15.123838 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 111/229] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:14 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1259 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:15.296510 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-67fdfe42-9828-44f8-8459-bb97db862fd8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:15.297887 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-67fdfe42-9828-44f8-8459-bb97db862fd8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:15.308196 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-67fdfe42-9828-44f8-8459-bb97db862fd8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:15.308929 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-67fdfe42-9828-44f8-8459-bb97db862fd8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:15.311125 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-67fdfe42-9828-44f8-8459-bb97db862fd8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:15.311812 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-67fdfe42-9828-44f8-8459-bb97db862fd8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:15.484310 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-67fdfe42-9828-44f8-8459-bb97db862fd8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:15.494991 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-67fdfe42-9828-44f8-8459-bb97db862fd8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29" status: 200 len: 1521 microversion: 2.1 time: 0.203037 Jun 23 13:41:15.496646 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 119/230] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:15 2022] GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:16.057862 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-a111bc46-e522-425b-a45a-b06b01905aca tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1559425366", "imageRef": "dd7aacbf-3b3e-496e-967e-53d2a1b1f200", "flavorRef": "452", "networks": [{"uuid": "641a390d-373a-419e-893a-8f57c4838f1f"}]}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:41:16.117789 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.network.neutron [None req-a111bc46-e522-425b-a45a-b06b01905aca tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] validate_networks() for [('641a390d-373a-419e-893a-8f57c4838f1f', None, None, None, None, None)] {{(pid=134666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 13:41:16.143085 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-ec7e9078-7f9b-4e9e-a443-34eeda2e66d1 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:16.143748 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-ec7e9078-7f9b-4e9e-a443-34eeda2e66d1 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:16.150851 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ec7e9078-7f9b-4e9e-a443-34eeda2e66d1 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:16.153354 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ec7e9078-7f9b-4e9e-a443-34eeda2e66d1 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:16.154403 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ec7e9078-7f9b-4e9e-a443-34eeda2e66d1 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:16.154839 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ec7e9078-7f9b-4e9e-a443-34eeda2e66d1 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:16.405800 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-ec7e9078-7f9b-4e9e-a443-34eeda2e66d1 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:16.413366 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-ec7e9078-7f9b-4e9e-a443-34eeda2e66d1 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1259 microversion: 2.1 time: 0.274403 Jun 23 13:41:16.422740 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 120/231] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:16 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1259 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:16.518759 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-b17658e8-609f-470e-8975-1fc1e5ae095a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:16.519601 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-b17658e8-609f-470e-8975-1fc1e5ae095a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:16.533592 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b17658e8-609f-470e-8975-1fc1e5ae095a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:16.534046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b17658e8-609f-470e-8975-1fc1e5ae095a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:16.537174 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b17658e8-609f-470e-8975-1fc1e5ae095a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:16.537680 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b17658e8-609f-470e-8975-1fc1e5ae095a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:16.856231 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-a111bc46-e522-425b-a45a-b06b01905aca tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Flavor limits 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 13:41:16.856813 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-a111bc46-e522-425b-a45a-b06b01905aca tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Image limits 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 13:41:16.857352 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-a111bc46-e522-425b-a45a-b06b01905aca tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Flavor pref 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 13:41:16.857730 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-a111bc46-e522-425b-a45a-b06b01905aca tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Image pref 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 13:41:16.858326 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-a111bc46-e522-425b-a45a-b06b01905aca tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 13:41:16.872591 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a111bc46-e522-425b-a45a-b06b01905aca tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:16.873507 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a111bc46-e522-425b-a45a-b06b01905aca tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:16.874494 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a111bc46-e522-425b-a45a-b06b01905aca tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:16.875138 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a111bc46-e522-425b-a45a-b06b01905aca tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:16.901402 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-a111bc46-e522-425b-a45a-b06b01905aca tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Getting quotas for project 5ed01b7f521c413e944560db54281ebc. Resources: {'ram', 'cores', 'instances'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:41:16.909198 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-a111bc46-e522-425b-a45a-b06b01905aca tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Getting quotas for user 7fd8fce7c040433e908a4fe6c6b13e08 and project 5ed01b7f521c413e944560db54281ebc. Resources: {'ram', 'cores', 'instances'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:41:16.932826 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-a111bc46-e522-425b-a45a-b06b01905aca tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Going to run 1 instances... {{(pid=134666) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 13:41:16.935925 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-a111bc46-e522-425b-a45a-b06b01905aca tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: be3d6429-ee63-4240-81e2-764a80f56740] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7aacbf-3b3e-496e-967e-53d2a1b1f200',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 13:41:16.942455 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-b17658e8-609f-470e-8975-1fc1e5ae095a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:16.953971 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-b17658e8-609f-470e-8975-1fc1e5ae095a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29" status: 200 len: 1521 microversion: 2.1 time: 0.437797 Jun 23 13:41:16.956783 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 121/232] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:16 2022] GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29 => generated 1521 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:41:16.967583 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-c83e689f-86d1-42c7-b7e9-f3d207e47f29 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:16.969465 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-c83e689f-86d1-42c7-b7e9-f3d207e47f29 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:16.973121 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_api:SELECT=42 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:16.982987 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c83e689f-86d1-42c7-b7e9-f3d207e47f29 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:16.983719 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c83e689f-86d1-42c7-b7e9-f3d207e47f29 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:16.984828 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c83e689f-86d1-42c7-b7e9-f3d207e47f29 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:16.985377 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c83e689f-86d1-42c7-b7e9-f3d207e47f29 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:17.012835 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-c83e689f-86d1-42c7-b7e9-f3d207e47f29 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa/ips" status: 200 len: 150 microversion: 2.1 time: 0.054399 Jun 23 13:41:17.013452 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 122/233] 10.222.0.26 () {58 vars in 1247 bytes} [Thu Jun 23 13:41:16 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa/ips => generated 150 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:41:17.046862 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-a111bc46-e522-425b-a45a-b06b01905aca tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.992741 Jun 23 13:41:17.047628 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 112/234] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Jun 23 13:41:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 13:41:17.064773 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-16d49c7c-4936-4c67-90fe-d31b3c12aa32 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:17.066574 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-16d49c7c-4936-4c67-90fe-d31b3c12aa32 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: be3d6429-ee63-4240-81e2-764a80f56740] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:17.163369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-16d49c7c-4936-4c67-90fe-d31b3c12aa32 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:17.172053 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-16d49c7c-4936-4c67-90fe-d31b3c12aa32 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740" status: 200 len: 1219 microversion: 2.1 time: 0.117602 Jun 23 13:41:17.173054 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 123/235] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:17 2022] GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740 => generated 1219 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:17.430236 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-01add386-ac35-43ec-8fe2-251dd561ade4 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:17.430846 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-01add386-ac35-43ec-8fe2-251dd561ade4 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:17.441123 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-01add386-ac35-43ec-8fe2-251dd561ade4 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:17.441631 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-01add386-ac35-43ec-8fe2-251dd561ade4 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:17.442426 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-01add386-ac35-43ec-8fe2-251dd561ade4 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:17.442914 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-01add386-ac35-43ec-8fe2-251dd561ade4 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:17.589359 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-01add386-ac35-43ec-8fe2-251dd561ade4 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:17.597983 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-01add386-ac35-43ec-8fe2-251dd561ade4 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1259 microversion: 2.1 time: 0.171742 Jun 23 13:41:17.598830 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 113/236] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:17 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:17.974084 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-c9699670-d10d-4cdc-b17d-41921d694f8b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:17.974698 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-c9699670-d10d-4cdc-b17d-41921d694f8b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:17.983919 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c9699670-d10d-4cdc-b17d-41921d694f8b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:17.984614 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c9699670-d10d-4cdc-b17d-41921d694f8b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:17.985392 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c9699670-d10d-4cdc-b17d-41921d694f8b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:17.985827 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c9699670-d10d-4cdc-b17d-41921d694f8b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:18.152111 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-c9699670-d10d-4cdc-b17d-41921d694f8b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:18.164579 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-c9699670-d10d-4cdc-b17d-41921d694f8b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29" status: 200 len: 1521 microversion: 2.1 time: 0.194320 Jun 23 13:41:18.165643 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 124/237] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:17 2022] GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:18.192309 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-27c27ada-a6f5-4857-acf7-a08fff0fe8f3 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:18.198027 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-27c27ada-a6f5-4857-acf7-a08fff0fe8f3 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: be3d6429-ee63-4240-81e2-764a80f56740] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:18.207799 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-27c27ada-a6f5-4857-acf7-a08fff0fe8f3 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:18.208540 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-27c27ada-a6f5-4857-acf7-a08fff0fe8f3 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:18.209909 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-27c27ada-a6f5-4857-acf7-a08fff0fe8f3 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:18.211821 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-27c27ada-a6f5-4857-acf7-a08fff0fe8f3 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:18.282380 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-27c27ada-a6f5-4857-acf7-a08fff0fe8f3 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:18.290444 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-27c27ada-a6f5-4857-acf7-a08fff0fe8f3 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740" status: 200 len: 1223 microversion: 2.1 time: 0.104153 Jun 23 13:41:18.290964 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 114/238] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:18 2022] GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740 => generated 1223 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:18.475721 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-6a59174c-9db9-4052-b5d0-cc686aad41b4 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e61a02d4-713d-4f3d-9861-f9c8b8a956e0"}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:41:18.477125 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-6a59174c-9db9-4052-b5d0-cc686aad41b4 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:18.483389 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6a59174c-9db9-4052-b5d0-cc686aad41b4 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:18.483727 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6a59174c-9db9-4052-b5d0-cc686aad41b4 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:18.484500 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6a59174c-9db9-4052-b5d0-cc686aad41b4 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:18.484935 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6a59174c-9db9-4052-b5d0-cc686aad41b4 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:18.615910 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-71f8598c-32b0-453a-9aa1-7eb8d7417eee tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:18.617506 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-71f8598c-32b0-453a-9aa1-7eb8d7417eee tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:18.629230 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-71f8598c-32b0-453a-9aa1-7eb8d7417eee tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:18.630293 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-71f8598c-32b0-453a-9aa1-7eb8d7417eee tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:18.631874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-71f8598c-32b0-453a-9aa1-7eb8d7417eee tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:18.632617 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-71f8598c-32b0-453a-9aa1-7eb8d7417eee tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:18.796661 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-71f8598c-32b0-453a-9aa1-7eb8d7417eee tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:18.798995 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-6a59174c-9db9-4052-b5d0-cc686aad41b4 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "POST /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.327398 Jun 23 13:41:18.799834 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 125/239] 10.222.0.26 () {60 vars in 1322 bytes} [Thu Jun 23 13:41:18 2022] POST /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa/os-volume_attachments => generated 194 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 13:41:18.805734 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-71f8598c-32b0-453a-9aa1-7eb8d7417eee tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1259 microversion: 2.1 time: 0.194808 Jun 23 13:41:18.806961 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 115/240] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:18 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1259 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:41:19.185861 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-6f04272b-fa5e-4d27-bc3f-bc32e9f20c2b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:19.186561 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-6f04272b-fa5e-4d27-bc3f-bc32e9f20c2b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:19.193762 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6f04272b-fa5e-4d27-bc3f-bc32e9f20c2b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:19.194309 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6f04272b-fa5e-4d27-bc3f-bc32e9f20c2b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:19.195207 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6f04272b-fa5e-4d27-bc3f-bc32e9f20c2b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:19.195797 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6f04272b-fa5e-4d27-bc3f-bc32e9f20c2b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:19.307792 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-fb363808-65f4-4c11-8a58-ebfc26113c5b tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:19.308399 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-fb363808-65f4-4c11-8a58-ebfc26113c5b tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: be3d6429-ee63-4240-81e2-764a80f56740] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:19.321022 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fb363808-65f4-4c11-8a58-ebfc26113c5b tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:19.321514 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fb363808-65f4-4c11-8a58-ebfc26113c5b tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:19.322238 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fb363808-65f4-4c11-8a58-ebfc26113c5b tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:19.322693 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fb363808-65f4-4c11-8a58-ebfc26113c5b tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:19.381144 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-6f04272b-fa5e-4d27-bc3f-bc32e9f20c2b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:19.395690 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-6f04272b-fa5e-4d27-bc3f-bc32e9f20c2b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29" status: 200 len: 1521 microversion: 2.1 time: 0.213811 Jun 23 13:41:19.404542 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-fb363808-65f4-4c11-8a58-ebfc26113c5b tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:19.406783 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 126/241] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:19 2022] GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:19.417899 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-fb363808-65f4-4c11-8a58-ebfc26113c5b tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740" status: 200 len: 1271 microversion: 2.1 time: 0.114575 Jun 23 13:41:19.429250 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 116/242] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:19 2022] GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740 => generated 1271 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:19.826110 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-8e99a90b-a552-4c2e-a8f4-8405fd51ba2d tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:19.826995 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-8e99a90b-a552-4c2e-a8f4-8405fd51ba2d tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:19.852910 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8e99a90b-a552-4c2e-a8f4-8405fd51ba2d tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:19.856798 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8e99a90b-a552-4c2e-a8f4-8405fd51ba2d tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:19.860075 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8e99a90b-a552-4c2e-a8f4-8405fd51ba2d tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:19.860697 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8e99a90b-a552-4c2e-a8f4-8405fd51ba2d tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:20.068705 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-8e99a90b-a552-4c2e-a8f4-8405fd51ba2d tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:20.078164 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-8e99a90b-a552-4c2e-a8f4-8405fd51ba2d tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1259 microversion: 2.1 time: 0.258381 Jun 23 13:41:20.078952 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 127/243] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:19 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1259 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:20.412842 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-a72ec421-94ac-4864-ae66-372e4e98b615 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:20.413549 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-a72ec421-94ac-4864-ae66-372e4e98b615 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:20.420330 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a72ec421-94ac-4864-ae66-372e4e98b615 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:20.420846 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a72ec421-94ac-4864-ae66-372e4e98b615 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:20.421647 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a72ec421-94ac-4864-ae66-372e4e98b615 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:20.422411 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a72ec421-94ac-4864-ae66-372e4e98b615 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:20.435788 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-a4979189-c733-42f9-aa99-ff76ed7a6313 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:20.436481 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-a4979189-c733-42f9-aa99-ff76ed7a6313 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: be3d6429-ee63-4240-81e2-764a80f56740] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:20.443192 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a4979189-c733-42f9-aa99-ff76ed7a6313 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:20.443923 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a4979189-c733-42f9-aa99-ff76ed7a6313 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:20.445033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a4979189-c733-42f9-aa99-ff76ed7a6313 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:20.445681 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a4979189-c733-42f9-aa99-ff76ed7a6313 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:20.588099 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-a4979189-c733-42f9-aa99-ff76ed7a6313 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:20.600498 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-a4979189-c733-42f9-aa99-ff76ed7a6313 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740" status: 200 len: 1277 microversion: 2.1 time: 0.165503 Jun 23 13:41:20.601580 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 128/244] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:20 2022] GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740 => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:20.675574 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-a72ec421-94ac-4864-ae66-372e4e98b615 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:20.684708 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-a72ec421-94ac-4864-ae66-372e4e98b615 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29" status: 200 len: 1521 microversion: 2.1 time: 0.275897 Jun 23 13:41:20.694584 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 117/245] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:20 2022] GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29 => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:21.096622 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-efbfa1f5-e040-4edb-a2b9-562d8348f4bb tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:21.098090 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-efbfa1f5-e040-4edb-a2b9-562d8348f4bb tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:21.119072 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-efbfa1f5-e040-4edb-a2b9-562d8348f4bb tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:21.119482 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-efbfa1f5-e040-4edb-a2b9-562d8348f4bb tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:21.123903 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-efbfa1f5-e040-4edb-a2b9-562d8348f4bb tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:21.124587 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-efbfa1f5-e040-4edb-a2b9-562d8348f4bb tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:21.146736 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:21.451499 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-efbfa1f5-e040-4edb-a2b9-562d8348f4bb tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:21.459783 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-efbfa1f5-e040-4edb-a2b9-562d8348f4bb tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1259 microversion: 2.1 time: 0.367741 Jun 23 13:41:21.473176 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 129/246] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:21 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1259 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:21.621011 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-2fb7a1c6-84b5-4b9f-a6b0-50a599f73d0e tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:21.623023 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-2fb7a1c6-84b5-4b9f-a6b0-50a599f73d0e tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: be3d6429-ee63-4240-81e2-764a80f56740] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:21.632309 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2fb7a1c6-84b5-4b9f-a6b0-50a599f73d0e tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:21.634136 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2fb7a1c6-84b5-4b9f-a6b0-50a599f73d0e tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:21.635466 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2fb7a1c6-84b5-4b9f-a6b0-50a599f73d0e tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:21.637094 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2fb7a1c6-84b5-4b9f-a6b0-50a599f73d0e tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:21.702474 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-e4ad9caa-faa2-41b3-b56e-e7c56a07bbd8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:21.703285 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-e4ad9caa-faa2-41b3-b56e-e7c56a07bbd8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:21.715225 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e4ad9caa-faa2-41b3-b56e-e7c56a07bbd8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:21.716062 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e4ad9caa-faa2-41b3-b56e-e7c56a07bbd8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:21.723403 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e4ad9caa-faa2-41b3-b56e-e7c56a07bbd8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:21.724146 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e4ad9caa-faa2-41b3-b56e-e7c56a07bbd8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:21.915732 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-2fb7a1c6-84b5-4b9f-a6b0-50a599f73d0e tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:21.925946 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-2fb7a1c6-84b5-4b9f-a6b0-50a599f73d0e tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740" status: 200 len: 1319 microversion: 2.1 time: 0.311595 Jun 23 13:41:21.928604 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 118/247] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:21 2022] GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740 => generated 1319 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:21.983938 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-e4ad9caa-faa2-41b3-b56e-e7c56a07bbd8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:21.997585 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-e4ad9caa-faa2-41b3-b56e-e7c56a07bbd8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29" status: 200 len: 1501 microversion: 2.1 time: 0.295633 Jun 23 13:41:21.998754 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 130/248] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:21 2022] GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29 => generated 1501 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:22.014468 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-16fe370f-45fa-4d72-ba67-980b882bcc97 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b037bb57-69b0-4081-bf9b-80db2153437e"}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:41:22.015646 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-16fe370f-45fa-4d72-ba67-980b882bcc97 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:22.030718 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-16fe370f-45fa-4d72-ba67-980b882bcc97 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:22.031176 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-16fe370f-45fa-4d72-ba67-980b882bcc97 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:22.032000 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-16fe370f-45fa-4d72-ba67-980b882bcc97 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:22.032425 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-16fe370f-45fa-4d72-ba67-980b882bcc97 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:22.080456 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.wsgi [None req-16fe370f-45fa-4d72-ba67-980b882bcc97 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] HTTP exception thrown: Cannot 'attach_volume' instance ee2cdaf7-cefe-4877-b855-b4646b50cf29 while it is in vm_state rescued Jun 23 13:41:22.086965 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-16fe370f-45fa-4d72-ba67-980b882bcc97 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Request method failure captured: Jun 23 13:41:22.086965 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: request: POST /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29/os-volume_attachments HTTP/1.1 Jun 23 13:41:22.086965 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept: application/json Jun 23 13:41:22.086965 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept-Encoding: identity Jun 23 13:41:22.086965 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Connection: close Jun 23 13:41:22.086965 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Length: 74 Jun 23 13:41:22.086965 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Type: application/json Jun 23 13:41:22.086965 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Host: 10.222.0.26 Jun 23 13:41:22.086965 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Openstack-System-Scope: None Jun 23 13:41:22.086965 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: User-Agent: python-urllib3/1.26.9 Jun 23 13:41:22.086965 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Auth-Token: gAAAAABitG0Sk3ITYqPOix6d-yn0tfx-OSIDvIuV7UJjc74SbWZgVnKUDm8nfkPPw_HDdmKI8sNR-ZRrPiM2VFS2aGUijneFicZmaRheJVdwbvopsixSQO0yPOZxFVs3fvoZ2ibh1WvoqBrlfRHbN7g-Iz0o0UFhet-npHvAovII03AWNWb9zgg Jun 23 13:41:22.086965 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Id: None Jun 23 13:41:22.086965 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Name: None Jun 23 13:41:22.086965 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Identity-Status: Confirmed Jun 23 13:41:22.086965 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Is-Admin-Project: True Jun 23 13:41:22.086965 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Id: default Jun 23 13:41:22.086965 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Name: Default Jun 23 13:41:22.086965 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Id: 855cb6e79485414ab0f2a40162231d72 Jun 23 13:41:22.086965 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-140294951 Jun 23 13:41:22.086965 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Role: member,reader Jun 23 13:41:22.086965 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Roles: member,reader Jun 23 13:41:22.088208 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/855cb6e79485414ab0f2a40162231d72"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/855cb6e79485414ab0f2a40162231d72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/855cb6e79485414ab0f2a40162231d72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_855cb6e79485414ab0f2a40162231d72", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:41:22.088208 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant: tempest-ServerRescueNegativeTestJSON-140294951 Jun 23 13:41:22.088208 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Id: 855cb6e79485414ab0f2a40162231d72 Jun 23 13:41:22.088208 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-140294951 Jun 23 13:41:22.088208 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User: tempest-ServerRescueNegativeTestJSON-140294951-project Jun 23 13:41:22.088208 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Id: default Jun 23 13:41:22.088208 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Name: Default Jun 23 13:41:22.088208 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Id: ae510389cfc04a0cb4e6991df2a93a00 Jun 23 13:41:22.088208 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Name: tempest-ServerRescueNegativeTestJSON-140294951-project Jun 23 13:41:22.088208 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Jun 23 13:41:22.088208 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: {"volumeAttachment": {"volumeId": "b037bb57-69b0-4081-bf9b-80db2153437e"}} Jun 23 13:41:22.088208 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: method: > Jun 23 13:41:22.088912 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: exception: Cannot 'attach_volume' instance ee2cdaf7-cefe-4877-b855-b4646b50cf29 while it is in vm_state rescued Jun 23 13:41:22.088912 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: action_args: {'server_id': 'ee2cdaf7-cefe-4877-b855-b4646b50cf29', 'body': {'volumeAttachment': {'volumeId': 'b037bb57-69b0-4081-bf9b-80db2153437e'}}} Jun 23 13:41:22.088912 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:41:22.088912 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:41:22.088912 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 13:41:22.088912 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 13:41:22.088912 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 13:41:22.088912 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 13:41:22.088912 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 23 13:41:22.088912 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 23 13:41:22.088912 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ee2cdaf7-cefe-4877-b855-b4646b50cf29 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 23 13:41:22.088912 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:41:22.088912 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:41:22.088912 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:41:22.088912 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:41:22.088912 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:41:22.088912 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:41:22.088912 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:41:22.088912 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:41:22.090140 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:41:22.090140 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:41:22.090140 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 13:41:22.090140 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 13:41:22.090140 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 13:41:22.090140 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 13:41:22.090140 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 13:41:22.090140 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 13:41:22.090140 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 23 13:41:22.090140 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 23 13:41:22.090140 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 23 13:41:22.090140 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 23 13:41:22.090140 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ee2cdaf7-cefe-4877-b855-b4646b50cf29 while it is in vm_state rescued Jun 23 13:41:22.090140 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:41:22.090140 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:41:22.090140 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:41:22.090140 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:41:22.090140 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:41:22.090140 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:41:22.091171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:41:22.091171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:41:22.091171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ee2cdaf7-cefe-4877-b855-b4646b50cf29 while it is in vm_state rescued Jun 23 13:41:22.091171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:41:22.091171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-16fe370f-45fa-4d72-ba67-980b882bcc97 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Returning 409 to user: Cannot 'attach_volume' instance ee2cdaf7-cefe-4877-b855-b4646b50cf29 while it is in vm_state rescued {{(pid=134666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:41:22.091171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-16fe370f-45fa-4d72-ba67-980b882bcc97 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "POST /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.080642 Jun 23 13:41:22.094138 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 119/249] 10.222.0.26 () {60 vars in 1322 bytes} [Thu Jun 23 13:41:22 2022] POST /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29/os-volume_attachments => generated 152 bytes in 84 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 23 13:41:22.099594 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-55537d85-0d08-49cc-b7ef-d1339f1e276e req-85891f13-e40e-41b5-b56d-36a19c311dbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a0e254-8280-4e56-80e6-525cca5dcac3", "name": "network-vif-plugged", "status": "completed", "tag": "c680d421-4232-46b9-bea8-b492d2e2f651"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:41:22.115068 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-db6e53f2-a960-42e1-8542-74bfb27c6ad4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:41:22.116534 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-db6e53f2-a960-42e1-8542-74bfb27c6ad4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:22.128577 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-55537d85-0d08-49cc-b7ef-d1339f1e276e req-85891f13-e40e-41b5-b56d-36a19c311dbd service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:22.135170 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-db6e53f2-a960-42e1-8542-74bfb27c6ad4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:22.137266 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-db6e53f2-a960-42e1-8542-74bfb27c6ad4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:22.139260 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-db6e53f2-a960-42e1-8542-74bfb27c6ad4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:22.139928 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-55537d85-0d08-49cc-b7ef-d1339f1e276e req-85891f13-e40e-41b5-b56d-36a19c311dbd service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:22.140376 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-db6e53f2-a960-42e1-8542-74bfb27c6ad4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:22.172747 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-55537d85-0d08-49cc-b7ef-d1339f1e276e req-85891f13-e40e-41b5-b56d-36a19c311dbd service nova] Creating event network-vif-plugged:c680d421-4232-46b9-bea8-b492d2e2f651 for instance 89a0e254-8280-4e56-80e6-525cca5dcac3 on hv-cinder-81558 Jun 23 13:41:22.179752 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-55537d85-0d08-49cc-b7ef-d1339f1e276e req-85891f13-e40e-41b5-b56d-36a19c311dbd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084119 Jun 23 13:41:22.180719 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 131/250] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 13:41:22.306939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-db6e53f2-a960-42e1-8542-74bfb27c6ad4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "POST /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29/action" status: 202 len: 0 microversion: 2.1 time: 0.204916 Jun 23 13:41:22.308170 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 120/251] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Jun 23 13:41:22 2022] POST /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 13:41:22.317688 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-b91d7e5c-a906-470b-8f79-562ed9da939c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:22.318790 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-b91d7e5c-a906-470b-8f79-562ed9da939c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:22.325980 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b91d7e5c-a906-470b-8f79-562ed9da939c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:22.326808 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b91d7e5c-a906-470b-8f79-562ed9da939c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:22.328000 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b91d7e5c-a906-470b-8f79-562ed9da939c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:22.328881 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b91d7e5c-a906-470b-8f79-562ed9da939c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:22.489102 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-db76716e-38e7-4493-9ea9-161c6eaf63a9 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:22.490861 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-db76716e-38e7-4493-9ea9-161c6eaf63a9 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:22.500818 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-db76716e-38e7-4493-9ea9-161c6eaf63a9 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:22.501813 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-db76716e-38e7-4493-9ea9-161c6eaf63a9 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:22.502962 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-db76716e-38e7-4493-9ea9-161c6eaf63a9 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:22.504009 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-db76716e-38e7-4493-9ea9-161c6eaf63a9 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:22.558549 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-b91d7e5c-a906-470b-8f79-562ed9da939c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:22.577700 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-b91d7e5c-a906-470b-8f79-562ed9da939c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29" status: 200 len: 1509 microversion: 2.1 time: 0.264639 Jun 23 13:41:22.578627 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 132/252] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:22 2022] GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29 => generated 1509 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:41:22.587657 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-7cadabbf-0805-4983-9791-7d0f709d30d2 req-4ad50a1d-8009-43e1-b02b-7fb81c7e8609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be3d6429-ee63-4240-81e2-764a80f56740", "tag": "b7c518e1-beb1-491b-99ec-6f9a8f70d5f6"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:41:22.604709 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-7cadabbf-0805-4983-9791-7d0f709d30d2 req-4ad50a1d-8009-43e1-b02b-7fb81c7e8609 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:22.605451 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-7cadabbf-0805-4983-9791-7d0f709d30d2 req-4ad50a1d-8009-43e1-b02b-7fb81c7e8609 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:22.642690 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-7cadabbf-0805-4983-9791-7d0f709d30d2 req-4ad50a1d-8009-43e1-b02b-7fb81c7e8609 service nova] Creating event network-changed:b7c518e1-beb1-491b-99ec-6f9a8f70d5f6 for instance be3d6429-ee63-4240-81e2-764a80f56740 on hv-cinder-81558 Jun 23 13:41:22.657661 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-7cadabbf-0805-4983-9791-7d0f709d30d2 req-4ad50a1d-8009-43e1-b02b-7fb81c7e8609 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077766 Jun 23 13:41:22.658787 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 133/253] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:41:22.709044 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-db76716e-38e7-4493-9ea9-161c6eaf63a9 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:22.720180 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-db76716e-38e7-4493-9ea9-161c6eaf63a9 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1259 microversion: 2.1 time: 0.241635 Jun 23 13:41:22.724114 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 121/254] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:22 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1259 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:22.945899 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-da3cb7d2-c5f7-4d78-a4b8-321d918c4201 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:22.946877 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-da3cb7d2-c5f7-4d78-a4b8-321d918c4201 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: be3d6429-ee63-4240-81e2-764a80f56740] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:22.953305 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-da3cb7d2-c5f7-4d78-a4b8-321d918c4201 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:22.953754 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-da3cb7d2-c5f7-4d78-a4b8-321d918c4201 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:22.954511 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-da3cb7d2-c5f7-4d78-a4b8-321d918c4201 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:22.954933 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-da3cb7d2-c5f7-4d78-a4b8-321d918c4201 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:23.089825 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-da3cb7d2-c5f7-4d78-a4b8-321d918c4201 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:23.097490 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-da3cb7d2-c5f7-4d78-a4b8-321d918c4201 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740" status: 200 len: 1319 microversion: 2.1 time: 0.156299 Jun 23 13:41:23.098593 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 134/255] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:22 2022] GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:23.596185 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-2b34d9dd-a297-429a-848e-01941d431bf7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:23.596797 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-2b34d9dd-a297-429a-848e-01941d431bf7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:23.603231 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2b34d9dd-a297-429a-848e-01941d431bf7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:23.603969 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2b34d9dd-a297-429a-848e-01941d431bf7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:23.605112 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2b34d9dd-a297-429a-848e-01941d431bf7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:23.613739 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2b34d9dd-a297-429a-848e-01941d431bf7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:23.737364 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-64a26555-1a92-4e19-a019-4ce34d251fc8 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:23.738745 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-64a26555-1a92-4e19-a019-4ce34d251fc8 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:23.745918 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-64a26555-1a92-4e19-a019-4ce34d251fc8 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:23.746643 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-64a26555-1a92-4e19-a019-4ce34d251fc8 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:23.748309 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-64a26555-1a92-4e19-a019-4ce34d251fc8 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:23.748939 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-64a26555-1a92-4e19-a019-4ce34d251fc8 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:23.780448 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-2b34d9dd-a297-429a-848e-01941d431bf7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:23.788626 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-2b34d9dd-a297-429a-848e-01941d431bf7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29" status: 200 len: 1509 microversion: 2.1 time: 0.196251 Jun 23 13:41:23.789199 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 122/256] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:23 2022] GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29 => generated 1509 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:23.951998 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-64a26555-1a92-4e19-a019-4ce34d251fc8 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:23.963409 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-64a26555-1a92-4e19-a019-4ce34d251fc8 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1259 microversion: 2.1 time: 0.230237 Jun 23 13:41:23.964188 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 135/257] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:23 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1259 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:24.117297 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-675fc96e-8354-4576-a9f4-29171d06869c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:24.118122 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-675fc96e-8354-4576-a9f4-29171d06869c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: be3d6429-ee63-4240-81e2-764a80f56740] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:24.129863 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-675fc96e-8354-4576-a9f4-29171d06869c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:24.130405 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-675fc96e-8354-4576-a9f4-29171d06869c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:24.131228 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-675fc96e-8354-4576-a9f4-29171d06869c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:24.131914 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-675fc96e-8354-4576-a9f4-29171d06869c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:24.269904 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-675fc96e-8354-4576-a9f4-29171d06869c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:24.277971 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-675fc96e-8354-4576-a9f4-29171d06869c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740" status: 200 len: 1319 microversion: 2.1 time: 0.165729 Jun 23 13:41:24.278601 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 123/258] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:24 2022] GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:24.739222 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-43c324e3-a0d6-47a1-8eb4-1d6d8f91bda7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:24.740317 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-43c324e3-a0d6-47a1-8eb4-1d6d8f91bda7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:24.746902 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-43c324e3-a0d6-47a1-8eb4-1d6d8f91bda7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:24.747369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-43c324e3-a0d6-47a1-8eb4-1d6d8f91bda7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:24.748145 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-43c324e3-a0d6-47a1-8eb4-1d6d8f91bda7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:24.748571 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-43c324e3-a0d6-47a1-8eb4-1d6d8f91bda7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:24.774454 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-43c324e3-a0d6-47a1-8eb4-1d6d8f91bda7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/ips" status: 200 len: 151 microversion: 2.20 time: 0.039528 Jun 23 13:41:24.775026 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 136/259] 10.222.0.26 () {60 vars in 1288 bytes} [Thu Jun 23 13:41:24 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 13:41:24.806046 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-aae191a6-b365-4a1c-98df-af6683e6519d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:24.806747 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-aae191a6-b365-4a1c-98df-af6683e6519d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:24.812886 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-aae191a6-b365-4a1c-98df-af6683e6519d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:24.813448 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-aae191a6-b365-4a1c-98df-af6683e6519d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:24.814092 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-aae191a6-b365-4a1c-98df-af6683e6519d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:24.814533 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-aae191a6-b365-4a1c-98df-af6683e6519d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:24.957858 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-aae191a6-b365-4a1c-98df-af6683e6519d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:24.970219 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-aae191a6-b365-4a1c-98df-af6683e6519d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29" status: 200 len: 1509 microversion: 2.1 time: 0.168078 Jun 23 13:41:24.970801 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 124/260] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:24 2022] GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:24.985569 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-3e6ce4f0-d69e-42a8-90f4-7f355b731471 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:24.986168 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-3e6ce4f0-d69e-42a8-90f4-7f355b731471 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:24.992212 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3e6ce4f0-d69e-42a8-90f4-7f355b731471 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:24.992617 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3e6ce4f0-d69e-42a8-90f4-7f355b731471 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:24.993426 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3e6ce4f0-d69e-42a8-90f4-7f355b731471 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:24.993819 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3e6ce4f0-d69e-42a8-90f4-7f355b731471 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:25.173792 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-3e6ce4f0-d69e-42a8-90f4-7f355b731471 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:25.181831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-3e6ce4f0-d69e-42a8-90f4-7f355b731471 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1259 microversion: 2.1 time: 0.200358 Jun 23 13:41:25.191294 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 137/261] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:24 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1259 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:25.293919 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-1a7d5604-9565-4c6f-adfd-fc97140e4b2c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:25.294531 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-1a7d5604-9565-4c6f-adfd-fc97140e4b2c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: be3d6429-ee63-4240-81e2-764a80f56740] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:25.296634 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:25.302990 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1a7d5604-9565-4c6f-adfd-fc97140e4b2c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:25.303507 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1a7d5604-9565-4c6f-adfd-fc97140e4b2c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:25.304307 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1a7d5604-9565-4c6f-adfd-fc97140e4b2c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:25.304746 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1a7d5604-9565-4c6f-adfd-fc97140e4b2c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:25.323372 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:25.445652 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-1a7d5604-9565-4c6f-adfd-fc97140e4b2c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:25.453024 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-1a7d5604-9565-4c6f-adfd-fc97140e4b2c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740" status: 200 len: 1319 microversion: 2.1 time: 0.163009 Jun 23 13:41:25.453584 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 125/262] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:25 2022] GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:25.987652 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-40ae9c10-4b31-4505-9ee2-b9fdf29ffc40 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:25.988401 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-40ae9c10-4b31-4505-9ee2-b9fdf29ffc40 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:25.997638 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-40ae9c10-4b31-4505-9ee2-b9fdf29ffc40 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:25.998322 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-40ae9c10-4b31-4505-9ee2-b9fdf29ffc40 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:25.999279 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-40ae9c10-4b31-4505-9ee2-b9fdf29ffc40 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:25.999746 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-40ae9c10-4b31-4505-9ee2-b9fdf29ffc40 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:26.141110 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-40ae9c10-4b31-4505-9ee2-b9fdf29ffc40 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:26.149227 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-40ae9c10-4b31-4505-9ee2-b9fdf29ffc40 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29" status: 200 len: 1509 microversion: 2.1 time: 0.165457 Jun 23 13:41:26.149813 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 138/263] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:25 2022] GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:41:26.199217 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-dfa7fb16-a8d8-425e-81bd-9b50c0cab082 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:26.199971 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-dfa7fb16-a8d8-425e-81bd-9b50c0cab082 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:26.206753 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-dfa7fb16-a8d8-425e-81bd-9b50c0cab082 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:26.207209 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-dfa7fb16-a8d8-425e-81bd-9b50c0cab082 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:26.208048 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-dfa7fb16-a8d8-425e-81bd-9b50c0cab082 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:26.208492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-dfa7fb16-a8d8-425e-81bd-9b50c0cab082 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:26.363092 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-dfa7fb16-a8d8-425e-81bd-9b50c0cab082 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:26.372283 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-dfa7fb16-a8d8-425e-81bd-9b50c0cab082 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1259 microversion: 2.1 time: 0.177545 Jun 23 13:41:26.376322 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 126/264] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:26 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1259 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:26.471476 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-6651607a-cad0-48bc-ab9d-5167fb7ffa69 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:26.472264 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-6651607a-cad0-48bc-ab9d-5167fb7ffa69 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: be3d6429-ee63-4240-81e2-764a80f56740] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:26.478737 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6651607a-cad0-48bc-ab9d-5167fb7ffa69 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:26.479178 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6651607a-cad0-48bc-ab9d-5167fb7ffa69 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:26.480128 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6651607a-cad0-48bc-ab9d-5167fb7ffa69 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:26.480600 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6651607a-cad0-48bc-ab9d-5167fb7ffa69 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:26.637121 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-6651607a-cad0-48bc-ab9d-5167fb7ffa69 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:26.647655 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-6651607a-cad0-48bc-ab9d-5167fb7ffa69 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740" status: 200 len: 1319 microversion: 2.1 time: 0.180386 Jun 23 13:41:26.653256 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 139/265] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:26 2022] GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:26.761862 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-b369d6ed-55c4-4831-89e6-74858b68baf8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:41:26.762997 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-b369d6ed-55c4-4831-89e6-74858b68baf8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:26.769910 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b369d6ed-55c4-4831-89e6-74858b68baf8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:26.770371 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b369d6ed-55c4-4831-89e6-74858b68baf8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:26.771144 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b369d6ed-55c4-4831-89e6-74858b68baf8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:26.771616 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b369d6ed-55c4-4831-89e6-74858b68baf8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:26.793654 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.objects.instance [None req-b369d6ed-55c4-4831-89e6-74858b68baf8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lazy-loading 'flavor' on Instance uuid b9ddb941-db20-4a0c-b841-d99368ad4f21 {{(pid=134666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:41:26.895258 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell0:SELECT=4 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:26.924505 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell0:SELECT=12 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:27.168273 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-b369d6ed-55c4-4831-89e6-74858b68baf8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "POST /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/action" status: 202 len: 0 microversion: 2.20 time: 0.413101 Jun 23 13:41:27.169329 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-0d7c6e0b-725e-4ed6-8292-c140a7401b0f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:27.170021 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-0d7c6e0b-725e-4ed6-8292-c140a7401b0f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:27.173709 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 127/266] 10.222.0.26 () {62 vars in 1318 bytes} [Thu Jun 23 13:41:26 2022] POST /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 13:41:27.178518 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell0:SELECT=4 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:27.180116 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-bcaf2435-b4ac-4de4-969c-bd0eb5d5a84d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:27.181112 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-bcaf2435-b4ac-4de4-969c-bd0eb5d5a84d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:27.181486 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0d7c6e0b-725e-4ed6-8292-c140a7401b0f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:27.182317 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0d7c6e0b-725e-4ed6-8292-c140a7401b0f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:27.183587 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0d7c6e0b-725e-4ed6-8292-c140a7401b0f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:27.184570 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0d7c6e0b-725e-4ed6-8292-c140a7401b0f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:27.188258 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-bcaf2435-b4ac-4de4-969c-bd0eb5d5a84d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:27.188705 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-bcaf2435-b4ac-4de4-969c-bd0eb5d5a84d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:27.189627 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-bcaf2435-b4ac-4de4-969c-bd0eb5d5a84d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:27.190215 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-bcaf2435-b4ac-4de4-969c-bd0eb5d5a84d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:27.455216 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-0d7c6e0b-725e-4ed6-8292-c140a7401b0f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:27.465010 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-0d7c6e0b-725e-4ed6-8292-c140a7401b0f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29" status: 200 len: 1509 microversion: 2.1 time: 0.302113 Jun 23 13:41:27.472068 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 140/267] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:27 2022] GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29 => generated 1509 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:41:27.472068 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-26f83295-1d0d-4c47-b449-6a29c3676024 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:27.472068 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-26f83295-1d0d-4c47-b449-6a29c3676024 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:27.472769 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-bcaf2435-b4ac-4de4-969c-bd0eb5d5a84d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:27.478527 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-26f83295-1d0d-4c47-b449-6a29c3676024 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:27.479196 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-26f83295-1d0d-4c47-b449-6a29c3676024 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:27.480060 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-26f83295-1d0d-4c47-b449-6a29c3676024 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:27.480503 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-26f83295-1d0d-4c47-b449-6a29c3676024 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:27.482866 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-bcaf2435-b4ac-4de4-969c-bd0eb5d5a84d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:27.485479 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-bcaf2435-b4ac-4de4-969c-bd0eb5d5a84d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:27.487174 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-bcaf2435-b4ac-4de4-969c-bd0eb5d5a84d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1722 microversion: 2.20 time: 0.311934 Jun 23 13:41:27.499437 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 128/268] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:41:27 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1722 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:41:27.669733 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-5a1fcea9-eb52-4dc4-87d1-9f15116ea093 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:27.670436 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-5a1fcea9-eb52-4dc4-87d1-9f15116ea093 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: be3d6429-ee63-4240-81e2-764a80f56740] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:27.674592 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-26f83295-1d0d-4c47-b449-6a29c3676024 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:27.680433 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5a1fcea9-eb52-4dc4-87d1-9f15116ea093 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:27.681077 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5a1fcea9-eb52-4dc4-87d1-9f15116ea093 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:27.683606 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5a1fcea9-eb52-4dc4-87d1-9f15116ea093 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:27.684210 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5a1fcea9-eb52-4dc4-87d1-9f15116ea093 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:27.690086 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-26f83295-1d0d-4c47-b449-6a29c3676024 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1442 microversion: 2.1 time: 0.222778 Jun 23 13:41:27.694651 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 141/269] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:27 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1442 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:27.712783 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-4c691a9c-5b08-4b8b-949b-7725ea1da607 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:27.713814 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-4c691a9c-5b08-4b8b-949b-7725ea1da607 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:27.726498 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4c691a9c-5b08-4b8b-949b-7725ea1da607 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:27.727198 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4c691a9c-5b08-4b8b-949b-7725ea1da607 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:27.728146 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4c691a9c-5b08-4b8b-949b-7725ea1da607 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:27.728783 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4c691a9c-5b08-4b8b-949b-7725ea1da607 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:27.967026 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-5a1fcea9-eb52-4dc4-87d1-9f15116ea093 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:27.982301 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-5a1fcea9-eb52-4dc4-87d1-9f15116ea093 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740" status: 200 len: 1319 microversion: 2.1 time: 0.316354 Jun 23 13:41:27.982901 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 129/270] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:27 2022] GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740 => generated 1319 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:41:28.012544 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-4c691a9c-5b08-4b8b-949b-7725ea1da607 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:28.030265 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-4c691a9c-5b08-4b8b-949b-7725ea1da607 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1442 microversion: 2.1 time: 0.322869 Jun 23 13:41:28.030860 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 142/271] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:27 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1442 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:41:28.483175 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-a22c9638-a53c-4693-b17c-2ce9e176d13f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:28.483954 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-a22c9638-a53c-4693-b17c-2ce9e176d13f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:28.497080 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a22c9638-a53c-4693-b17c-2ce9e176d13f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:28.497583 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a22c9638-a53c-4693-b17c-2ce9e176d13f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:28.498382 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a22c9638-a53c-4693-b17c-2ce9e176d13f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:28.520576 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-87a2abd3-82eb-445c-ae11-6d8686a74e0b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:28.525030 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-87a2abd3-82eb-445c-ae11-6d8686a74e0b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:28.534713 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a22c9638-a53c-4693-b17c-2ce9e176d13f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:28.565513 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-87a2abd3-82eb-445c-ae11-6d8686a74e0b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:28.570548 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-87a2abd3-82eb-445c-ae11-6d8686a74e0b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:28.571526 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-87a2abd3-82eb-445c-ae11-6d8686a74e0b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:28.572043 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-87a2abd3-82eb-445c-ae11-6d8686a74e0b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:29.005357 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-87a2abd3-82eb-445c-ae11-6d8686a74e0b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:29.016226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-87a2abd3-82eb-445c-ae11-6d8686a74e0b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:29.019504 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-87a2abd3-82eb-445c-ae11-6d8686a74e0b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:29.021399 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-87a2abd3-82eb-445c-ae11-6d8686a74e0b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1722 microversion: 2.20 time: 0.518787 Jun 23 13:41:29.022544 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 143/272] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:41:28 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1722 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:41:29.027720 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-464c5389-0500-47cf-bc0c-e8c7b7192225 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:29.028586 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-464c5389-0500-47cf-bc0c-e8c7b7192225 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: be3d6429-ee63-4240-81e2-764a80f56740] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:29.036795 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-464c5389-0500-47cf-bc0c-e8c7b7192225 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:29.037950 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-464c5389-0500-47cf-bc0c-e8c7b7192225 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:29.038990 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-464c5389-0500-47cf-bc0c-e8c7b7192225 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:29.039313 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-a22c9638-a53c-4693-b17c-2ce9e176d13f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:29.039475 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-464c5389-0500-47cf-bc0c-e8c7b7192225 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:29.052711 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-a22c9638-a53c-4693-b17c-2ce9e176d13f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29" status: 200 len: 1509 microversion: 2.1 time: 0.574100 Jun 23 13:41:29.058002 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 130/273] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:28 2022] GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29 => generated 1509 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:29.307451 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-464c5389-0500-47cf-bc0c-e8c7b7192225 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:29.318343 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-464c5389-0500-47cf-bc0c-e8c7b7192225 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740" status: 200 len: 1319 microversion: 2.1 time: 0.293452 Jun 23 13:41:29.321844 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 144/274] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:29 2022] GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740 => generated 1319 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:29.934330 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c67b3712-8bff-4814-b38a-1ad62442637a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Action: 'create', calling method: .version_select at 0x7fd7727a6b80>, body: {"keypair": {"name": "tempest-keypair-777721427", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjQ8nQ1BEm7la5tc7jHhA4kWX5ZnL7vv/xbMXjix10Wd0i1JWAx9gT/z2nvYB+tbD8xGhVJ3uxFDD4AOHydrc4paXgY2qPPvig6xQ6LIm0dbNwak56zMt+h7dCzoidENg=="}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:41:29.952691 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-c67b3712-8bff-4814-b38a-1ad62442637a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Getting quotas for project 9298bf4635e84993b086309715cc7cbe. Resources: {'key_pairs'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:41:29.957925 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-c67b3712-8bff-4814-b38a-1ad62442637a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Getting quotas for user 007ce9b8109343e0914efe94c6aa6a89 and project 9298bf4635e84993b086309715cc7cbe. Resources: {'key_pairs'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:41:29.988033 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-c67b3712-8bff-4814-b38a-1ad62442637a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.058332 Jun 23 13:41:29.989030 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 131/275] 10.222.0.26 () {60 vars in 1158 bytes} [Thu Jun 23 13:41:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:41:30.045493 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-951710c2-0377-4f5e-96bb-678b16f58dd5 req-e2ffd117-8fa1-4fa1-8573-05d794101a5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be3d6429-ee63-4240-81e2-764a80f56740", "name": "network-vif-plugged", "status": "completed", "tag": "b7c518e1-beb1-491b-99ec-6f9a8f70d5f6"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:41:30.046174 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-629ecd5e-0d3e-4174-959a-bb57f4405dc9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:30.047167 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-629ecd5e-0d3e-4174-959a-bb57f4405dc9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:30.058389 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-951710c2-0377-4f5e-96bb-678b16f58dd5 req-e2ffd117-8fa1-4fa1-8573-05d794101a5b service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:30.064587 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-629ecd5e-0d3e-4174-959a-bb57f4405dc9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:30.065431 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-629ecd5e-0d3e-4174-959a-bb57f4405dc9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:30.066587 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-629ecd5e-0d3e-4174-959a-bb57f4405dc9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:30.067469 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-951710c2-0377-4f5e-96bb-678b16f58dd5 req-e2ffd117-8fa1-4fa1-8573-05d794101a5b service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:30.068868 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-629ecd5e-0d3e-4174-959a-bb57f4405dc9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:30.101750 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-951710c2-0377-4f5e-96bb-678b16f58dd5 req-e2ffd117-8fa1-4fa1-8573-05d794101a5b service nova] Creating event network-vif-plugged:b7c518e1-beb1-491b-99ec-6f9a8f70d5f6 for instance be3d6429-ee63-4240-81e2-764a80f56740 on hv-cinder-81558 Jun 23 13:41:30.112907 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-951710c2-0377-4f5e-96bb-678b16f58dd5 req-e2ffd117-8fa1-4fa1-8573-05d794101a5b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079968 Jun 23 13:41:30.114380 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 145/276] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:41:30.129957 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-04597177-cc65-4bab-801a-9f129c3d3d19 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:30.130782 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-04597177-cc65-4bab-801a-9f129c3d3d19 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:30.141208 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-04597177-cc65-4bab-801a-9f129c3d3d19 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:30.141649 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-04597177-cc65-4bab-801a-9f129c3d3d19 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:30.142412 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-04597177-cc65-4bab-801a-9f129c3d3d19 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:30.146149 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-04597177-cc65-4bab-801a-9f129c3d3d19 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:30.868252 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-629ecd5e-0d3e-4174-959a-bb57f4405dc9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:30.876616 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-629ecd5e-0d3e-4174-959a-bb57f4405dc9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:30.878103 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-629ecd5e-0d3e-4174-959a-bb57f4405dc9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:30.879700 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-629ecd5e-0d3e-4174-959a-bb57f4405dc9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1722 microversion: 2.20 time: 0.840700 Jun 23 13:41:30.891879 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 132/277] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:41:30 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1722 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 13:41:30.897557 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-fec4cbdc-83fd-48c6-b374-ec44e84204c5 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:30.898535 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-fec4cbdc-83fd-48c6-b374-ec44e84204c5 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: be3d6429-ee63-4240-81e2-764a80f56740] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:30.904869 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fec4cbdc-83fd-48c6-b374-ec44e84204c5 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:30.905308 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fec4cbdc-83fd-48c6-b374-ec44e84204c5 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:30.906266 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fec4cbdc-83fd-48c6-b374-ec44e84204c5 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:30.906697 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fec4cbdc-83fd-48c6-b374-ec44e84204c5 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:30.922849 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-04597177-cc65-4bab-801a-9f129c3d3d19 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:30.942289 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-04597177-cc65-4bab-801a-9f129c3d3d19 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29" status: 200 len: 1515 microversion: 2.1 time: 0.826168 Jun 23 13:41:30.955396 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 146/278] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:30 2022] GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29 => generated 1515 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:31.199891 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-fec4cbdc-83fd-48c6-b374-ec44e84204c5 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:31.215786 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-fec4cbdc-83fd-48c6-b374-ec44e84204c5 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740" status: 200 len: 1319 microversion: 2.1 time: 0.322263 Jun 23 13:41:31.216319 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 133/279] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:30 2022] GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740 => generated 1319 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:31.899757 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-8f09ccdf-99b4-48a9-b689-9c274f6c8189 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:31.901045 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-8f09ccdf-99b4-48a9-b689-9c274f6c8189 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:31.917568 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8f09ccdf-99b4-48a9-b689-9c274f6c8189 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:31.917568 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8f09ccdf-99b4-48a9-b689-9c274f6c8189 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:31.917568 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8f09ccdf-99b4-48a9-b689-9c274f6c8189 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:31.917568 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8f09ccdf-99b4-48a9-b689-9c274f6c8189 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:31.982128 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-b9b24083-d0a7-4a8c-859a-aeaf05421d70 req-ca3be99b-a194-4854-9c83-69181d6ce03d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89a0e254-8280-4e56-80e6-525cca5dcac3", "tag": "c680d421-4232-46b9-bea8-b492d2e2f651"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:41:31.994757 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-b9b24083-d0a7-4a8c-859a-aeaf05421d70 req-ca3be99b-a194-4854-9c83-69181d6ce03d service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:32.004394 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-b9b24083-d0a7-4a8c-859a-aeaf05421d70 req-ca3be99b-a194-4854-9c83-69181d6ce03d service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:32.230553 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-b9b24083-d0a7-4a8c-859a-aeaf05421d70 req-ca3be99b-a194-4854-9c83-69181d6ce03d service nova] Creating event network-changed:c680d421-4232-46b9-bea8-b492d2e2f651 for instance 89a0e254-8280-4e56-80e6-525cca5dcac3 on hv-cinder-81558 Jun 23 13:41:32.238751 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-b9b24083-d0a7-4a8c-859a-aeaf05421d70 req-ca3be99b-a194-4854-9c83-69181d6ce03d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.260476 Jun 23 13:41:32.240564 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 134/280] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:41:32.246345 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-8037555d-9954-48d6-b45a-29f802d202df tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1545780199", "imageRef": "dd7aacbf-3b3e-496e-967e-53d2a1b1f200", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "750f6de3-a7e6-4721-b369-b46085e03f9a"}], "security_groups": [{"name": "tempest-securitygroup--784473364"}], "key_name": "tempest-keypair-777721427", "user_data": "}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:41:32.265141 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-8f09ccdf-99b4-48a9-b689-9c274f6c8189 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:32.273763 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-8f09ccdf-99b4-48a9-b689-9c274f6c8189 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:32.275344 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-8f09ccdf-99b4-48a9-b689-9c274f6c8189 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:32.276623 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-8f09ccdf-99b4-48a9-b689-9c274f6c8189 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1722 microversion: 2.20 time: 0.382266 Jun 23 13:41:32.277250 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 147/281] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:41:31 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1722 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:41:32.296372 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-b0f784d9-73d5-413c-861e-7ead08f23d0a tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:32.297250 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-b0f784d9-73d5-413c-861e-7ead08f23d0a tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: be3d6429-ee63-4240-81e2-764a80f56740] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:32.305094 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b0f784d9-73d5-413c-861e-7ead08f23d0a tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:32.305722 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b0f784d9-73d5-413c-861e-7ead08f23d0a tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:32.307284 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b0f784d9-73d5-413c-861e-7ead08f23d0a tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:32.308273 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b0f784d9-73d5-413c-861e-7ead08f23d0a tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:32.333858 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=100 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:32.435113 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.network.neutron [None req-8037555d-9954-48d6-b45a-29f802d202df tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] validate_networks() for [('750f6de3-a7e6-4721-b369-b46085e03f9a', None, None, None, None, None)] {{(pid=134666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 13:41:32.561547 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-b0f784d9-73d5-413c-861e-7ead08f23d0a tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:32.569497 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-b0f784d9-73d5-413c-861e-7ead08f23d0a tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740" status: 200 len: 1507 microversion: 2.1 time: 0.279181 Jun 23 13:41:32.585550 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 148/282] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:32 2022] GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740 => generated 1507 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:32.598896 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-0fb54299-0119-45d4-875e-78dc46784844 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Action: 'create', calling method: .version_select at 0x7fd7724b7790>, body: {"keypair": {"name": "tempest-keypair-1031938696", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhQjao+6P+V4sU9YP4dGR5im5UhBJuUizeuo5KLz/WZ44ixAaGQ6GlJsLLfxNCm7bmsvgDE+tIHiSZL68PDGWYkRFCR2J5k6wa0J7DJxwMeOjk0LGcVlQC0ke5XWlYmnA=="}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:41:32.626329 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.quota [None req-0fb54299-0119-45d4-875e-78dc46784844 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Getting quotas for project 855cb6e79485414ab0f2a40162231d72. Resources: {'key_pairs'} {{(pid=134667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:41:32.634217 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.quota [None req-0fb54299-0119-45d4-875e-78dc46784844 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Getting quotas for user ae510389cfc04a0cb4e6991df2a93a00 and project 855cb6e79485414ab0f2a40162231d72. Resources: {'key_pairs'} {{(pid=134667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:41:32.670374 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-0fb54299-0119-45d4-875e-78dc46784844 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.078184 Jun 23 13:41:32.680474 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 149/283] 10.222.0.26 () {60 vars in 1158 bytes} [Thu Jun 23 13:41:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:41:33.074635 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-8037555d-9954-48d6-b45a-29f802d202df tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Flavor limits 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 13:41:33.075290 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-8037555d-9954-48d6-b45a-29f802d202df tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Image limits 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 13:41:33.075898 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-8037555d-9954-48d6-b45a-29f802d202df tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Flavor pref 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 13:41:33.076422 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-8037555d-9954-48d6-b45a-29f802d202df tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Image pref 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 13:41:33.076971 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-8037555d-9954-48d6-b45a-29f802d202df tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 13:41:33.115213 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8037555d-9954-48d6-b45a-29f802d202df tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:33.115702 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8037555d-9954-48d6-b45a-29f802d202df tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:33.117618 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8037555d-9954-48d6-b45a-29f802d202df tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:33.118054 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8037555d-9954-48d6-b45a-29f802d202df tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:33.166873 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-8037555d-9954-48d6-b45a-29f802d202df tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Getting quotas for project 9298bf4635e84993b086309715cc7cbe. Resources: {'ram', 'cores', 'instances'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:41:33.173292 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-8037555d-9954-48d6-b45a-29f802d202df tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Getting quotas for user 007ce9b8109343e0914efe94c6aa6a89 and project 9298bf4635e84993b086309715cc7cbe. Resources: {'ram', 'cores', 'instances'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:41:33.188473 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-8037555d-9954-48d6-b45a-29f802d202df tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Going to run 1 instances... {{(pid=134666) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 13:41:33.191580 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-8037555d-9954-48d6-b45a-29f802d202df tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7aacbf-3b3e-496e-967e-53d2a1b1f200',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 13:41:33.276140 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-8037555d-9954-48d6-b45a-29f802d202df tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.034288 Jun 23 13:41:33.277484 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 135/284] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Jun 23 13:41:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 1036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 13:41:33.289815 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-c9d678e1-6210-4f3c-8153-a8e319bbe1f2 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:33.290765 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-c9d678e1-6210-4f3c-8153-a8e319bbe1f2 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:33.308535 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c508f7a9-61ef-4ddd-973c-5ea1f6b43334 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:33.309677 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-c508f7a9-61ef-4ddd-973c-5ea1f6b43334 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:33.318450 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c508f7a9-61ef-4ddd-973c-5ea1f6b43334 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:33.319311 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c508f7a9-61ef-4ddd-973c-5ea1f6b43334 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:33.320830 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c508f7a9-61ef-4ddd-973c-5ea1f6b43334 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:33.321466 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c508f7a9-61ef-4ddd-973c-5ea1f6b43334 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:33.375972 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-c9d678e1-6210-4f3c-8153-a8e319bbe1f2 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:33.409243 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-c9d678e1-6210-4f3c-8153-a8e319bbe1f2 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 200 len: 1241 microversion: 2.1 time: 0.124173 Jun 23 13:41:33.409819 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 150/285] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:33 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 1241 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:33.653632 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-c508f7a9-61ef-4ddd-973c-5ea1f6b43334 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:33.667701 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-c508f7a9-61ef-4ddd-973c-5ea1f6b43334 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:33.669999 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-c508f7a9-61ef-4ddd-973c-5ea1f6b43334 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:33.672386 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-c508f7a9-61ef-4ddd-973c-5ea1f6b43334 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1722 microversion: 2.20 time: 0.369878 Jun 23 13:41:33.673293 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 136/286] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:41:33 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1722 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:41:34.428001 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-be3f4dea-48e4-49e4-9118-312e6ebb99b5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:34.428690 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-be3f4dea-48e4-49e4-9118-312e6ebb99b5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:34.436459 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-be3f4dea-48e4-49e4-9118-312e6ebb99b5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:34.437027 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-be3f4dea-48e4-49e4-9118-312e6ebb99b5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:34.438005 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-be3f4dea-48e4-49e4-9118-312e6ebb99b5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:34.438379 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-be3f4dea-48e4-49e4-9118-312e6ebb99b5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:34.548251 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-be3f4dea-48e4-49e4-9118-312e6ebb99b5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:34.561084 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-be3f4dea-48e4-49e4-9118-312e6ebb99b5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 200 len: 1245 microversion: 2.1 time: 0.137846 Jun 23 13:41:34.570280 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 151/287] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:34 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 1245 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:34.680099 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-804b3aac-ae90-409a-98c2-a57d9244872f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1330061602", "imageRef": "dd7aacbf-3b3e-496e-967e-53d2a1b1f200", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aa1c1aa4-3e5b-4496-86ec-113ba24a4995"}], "security_groups": [{"name": "tempest-securitygroup--176148624"}], "key_name": "tempest-keypair-1031938696", "user_data": "}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:41:34.695740 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-3f33fa81-cd8b-4536-a997-c649881e69d2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:34.696493 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-3f33fa81-cd8b-4536-a997-c649881e69d2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:34.704117 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3f33fa81-cd8b-4536-a997-c649881e69d2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:34.705142 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3f33fa81-cd8b-4536-a997-c649881e69d2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:34.706172 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3f33fa81-cd8b-4536-a997-c649881e69d2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:34.706953 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3f33fa81-cd8b-4536-a997-c649881e69d2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:34.836715 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.network.neutron [None req-804b3aac-ae90-409a-98c2-a57d9244872f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] validate_networks() for [('aa1c1aa4-3e5b-4496-86ec-113ba24a4995', None, None, None, None, None)] {{(pid=134666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 13:41:35.148120 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-3f33fa81-cd8b-4536-a997-c649881e69d2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:35.157149 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-3f33fa81-cd8b-4536-a997-c649881e69d2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:35.158654 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-3f33fa81-cd8b-4536-a997-c649881e69d2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:35.159948 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-3f33fa81-cd8b-4536-a997-c649881e69d2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1722 microversion: 2.20 time: 0.471930 Jun 23 13:41:35.160537 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 152/288] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:41:34 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1722 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:41:35.478575 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-804b3aac-ae90-409a-98c2-a57d9244872f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Flavor limits 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 13:41:35.478993 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-804b3aac-ae90-409a-98c2-a57d9244872f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Image limits 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 13:41:35.479502 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-804b3aac-ae90-409a-98c2-a57d9244872f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Flavor pref 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 13:41:35.479957 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-804b3aac-ae90-409a-98c2-a57d9244872f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Image pref 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 13:41:35.480363 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-804b3aac-ae90-409a-98c2-a57d9244872f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 13:41:35.493474 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-804b3aac-ae90-409a-98c2-a57d9244872f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:35.494188 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-804b3aac-ae90-409a-98c2-a57d9244872f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:35.495199 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-804b3aac-ae90-409a-98c2-a57d9244872f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:35.495997 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-804b3aac-ae90-409a-98c2-a57d9244872f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:35.517509 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-804b3aac-ae90-409a-98c2-a57d9244872f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Getting quotas for project 855cb6e79485414ab0f2a40162231d72. Resources: {'ram', 'cores', 'instances'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:41:35.524351 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-804b3aac-ae90-409a-98c2-a57d9244872f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Getting quotas for user ae510389cfc04a0cb4e6991df2a93a00 and project 855cb6e79485414ab0f2a40162231d72. Resources: {'ram', 'cores', 'instances'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:41:35.537833 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-804b3aac-ae90-409a-98c2-a57d9244872f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Going to run 1 instances... {{(pid=134666) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 13:41:35.540577 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-804b3aac-ae90-409a-98c2-a57d9244872f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7aacbf-3b3e-496e-967e-53d2a1b1f200',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 13:41:35.580211 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-4dacd639-09b8-4783-b8a2-022c08e57df0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:35.580822 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-4dacd639-09b8-4783-b8a2-022c08e57df0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:35.589061 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4dacd639-09b8-4783-b8a2-022c08e57df0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:35.589511 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4dacd639-09b8-4783-b8a2-022c08e57df0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:35.590333 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4dacd639-09b8-4783-b8a2-022c08e57df0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:35.590938 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4dacd639-09b8-4783-b8a2-022c08e57df0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:35.614490 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-804b3aac-ae90-409a-98c2-a57d9244872f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.938235 Jun 23 13:41:35.615937 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 137/289] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Jun 23 13:41:34 2022] POST /compute/v2.1/servers => generated 408 bytes in 941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 13:41:35.631546 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-2fbacb06-1b81-4312-a497-f3be2aa58efc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:35.633180 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-2fbacb06-1b81-4312-a497-f3be2aa58efc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:35.694538 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-4dacd639-09b8-4783-b8a2-022c08e57df0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:35.705896 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-4dacd639-09b8-4783-b8a2-022c08e57df0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 200 len: 1237 microversion: 2.1 time: 0.129410 Jun 23 13:41:35.706488 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 153/290] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:35 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 1237 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:41:35.753464 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-2fbacb06-1b81-4312-a497-f3be2aa58efc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:35.764753 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-2fbacb06-1b81-4312-a497-f3be2aa58efc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1246 microversion: 2.1 time: 0.141604 Jun 23 13:41:35.766419 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 138/291] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:35 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1246 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:36.180233 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-4b77338d-f507-49a9-ae67-a2d7318c6178 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:36.181357 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-4b77338d-f507-49a9-ae67-a2d7318c6178 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:36.196164 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4b77338d-f507-49a9-ae67-a2d7318c6178 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:36.199223 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4b77338d-f507-49a9-ae67-a2d7318c6178 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:36.200991 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4b77338d-f507-49a9-ae67-a2d7318c6178 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:36.202933 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4b77338d-f507-49a9-ae67-a2d7318c6178 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:36.411177 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-4b77338d-f507-49a9-ae67-a2d7318c6178 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:36.421811 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-4b77338d-f507-49a9-ae67-a2d7318c6178 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:36.424431 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-4b77338d-f507-49a9-ae67-a2d7318c6178 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:36.428889 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-4b77338d-f507-49a9-ae67-a2d7318c6178 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1722 microversion: 2.20 time: 0.253291 Jun 23 13:41:36.430082 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 154/292] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:41:36 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1722 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:41:36.725741 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-4728d760-686f-4d70-92c7-71aa7c4f19d8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:36.726413 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-4728d760-686f-4d70-92c7-71aa7c4f19d8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:36.737552 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4728d760-686f-4d70-92c7-71aa7c4f19d8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:36.737910 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4728d760-686f-4d70-92c7-71aa7c4f19d8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:36.738798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4728d760-686f-4d70-92c7-71aa7c4f19d8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:36.739095 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4728d760-686f-4d70-92c7-71aa7c4f19d8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:36.783008 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-68aad290-0e3d-40ab-b67a-8a8bfe8928b4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:36.783566 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-68aad290-0e3d-40ab-b67a-8a8bfe8928b4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:36.792282 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-68aad290-0e3d-40ab-b67a-8a8bfe8928b4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:36.792729 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-68aad290-0e3d-40ab-b67a-8a8bfe8928b4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:36.793501 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-68aad290-0e3d-40ab-b67a-8a8bfe8928b4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:36.793931 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-68aad290-0e3d-40ab-b67a-8a8bfe8928b4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:36.822474 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-4728d760-686f-4d70-92c7-71aa7c4f19d8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:36.836657 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-4728d760-686f-4d70-92c7-71aa7c4f19d8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 200 len: 1299 microversion: 2.1 time: 0.113894 Jun 23 13:41:36.837947 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 139/293] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:36 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 1299 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:36.871491 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-68aad290-0e3d-40ab-b67a-8a8bfe8928b4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:36.879617 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-68aad290-0e3d-40ab-b67a-8a8bfe8928b4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1298 microversion: 2.1 time: 0.101020 Jun 23 13:41:36.880572 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 155/294] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:36 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1298 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:37.447993 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-b1e79152-7bd7-4040-9560-a9c80aafaeed tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:37.448755 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-b1e79152-7bd7-4040-9560-a9c80aafaeed tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:37.455737 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b1e79152-7bd7-4040-9560-a9c80aafaeed tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:37.456302 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b1e79152-7bd7-4040-9560-a9c80aafaeed tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:37.457117 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b1e79152-7bd7-4040-9560-a9c80aafaeed tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:37.457557 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b1e79152-7bd7-4040-9560-a9c80aafaeed tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:37.600659 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-b1e79152-7bd7-4040-9560-a9c80aafaeed tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:37.610024 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-b1e79152-7bd7-4040-9560-a9c80aafaeed tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:37.611592 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-b1e79152-7bd7-4040-9560-a9c80aafaeed tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:37.612793 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-b1e79152-7bd7-4040-9560-a9c80aafaeed tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1722 microversion: 2.20 time: 0.168871 Jun 23 13:41:37.613384 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 140/295] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:41:37 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:41:37.854627 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-087245a2-61e1-4df7-b63d-e46622ac503b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:37.855923 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-087245a2-61e1-4df7-b63d-e46622ac503b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:37.862867 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-087245a2-61e1-4df7-b63d-e46622ac503b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:37.863393 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-087245a2-61e1-4df7-b63d-e46622ac503b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:37.864200 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-087245a2-61e1-4df7-b63d-e46622ac503b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:37.864632 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-087245a2-61e1-4df7-b63d-e46622ac503b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:37.898505 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-5be4a1f4-4a4e-4cca-9c1e-097cb677c1e8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:37.899360 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-5be4a1f4-4a4e-4cca-9c1e-097cb677c1e8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:37.906560 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5be4a1f4-4a4e-4cca-9c1e-097cb677c1e8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:37.907142 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5be4a1f4-4a4e-4cca-9c1e-097cb677c1e8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:37.908476 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5be4a1f4-4a4e-4cca-9c1e-097cb677c1e8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:37.908904 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5be4a1f4-4a4e-4cca-9c1e-097cb677c1e8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:37.947186 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-087245a2-61e1-4df7-b63d-e46622ac503b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:37.958685 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-087245a2-61e1-4df7-b63d-e46622ac503b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 200 len: 1299 microversion: 2.1 time: 0.108307 Jun 23 13:41:37.970809 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 156/296] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:37 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 1299 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:37.978174 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-5be4a1f4-4a4e-4cca-9c1e-097cb677c1e8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:37.985750 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-5be4a1f4-4a4e-4cca-9c1e-097cb677c1e8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1304 microversion: 2.1 time: 0.091966 Jun 23 13:41:37.986368 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 141/297] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:37 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:41:38.631191 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-7cdef66c-2f58-4613-bddb-0cffe304882e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:38.631719 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-7cdef66c-2f58-4613-bddb-0cffe304882e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:38.637989 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7cdef66c-2f58-4613-bddb-0cffe304882e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:38.638433 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7cdef66c-2f58-4613-bddb-0cffe304882e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:38.639204 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7cdef66c-2f58-4613-bddb-0cffe304882e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:38.639683 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7cdef66c-2f58-4613-bddb-0cffe304882e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:38.793773 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-7cdef66c-2f58-4613-bddb-0cffe304882e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:38.801918 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-7cdef66c-2f58-4613-bddb-0cffe304882e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:38.803476 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-7cdef66c-2f58-4613-bddb-0cffe304882e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:38.804641 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-7cdef66c-2f58-4613-bddb-0cffe304882e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1722 microversion: 2.20 time: 0.177587 Jun 23 13:41:38.805202 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 157/298] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:41:38 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:41:38.986371 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-e9fee05e-acc5-4a5c-a604-2e10a64d0e86 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:38.987705 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-e9fee05e-acc5-4a5c-a604-2e10a64d0e86 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:38.994967 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e9fee05e-acc5-4a5c-a604-2e10a64d0e86 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:38.995597 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e9fee05e-acc5-4a5c-a604-2e10a64d0e86 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:38.996386 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e9fee05e-acc5-4a5c-a604-2e10a64d0e86 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:38.996786 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e9fee05e-acc5-4a5c-a604-2e10a64d0e86 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:39.003687 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-f220a05e-f89e-4926-8d12-43de2fabf8f4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:39.004637 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-f220a05e-f89e-4926-8d12-43de2fabf8f4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:39.014294 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f220a05e-f89e-4926-8d12-43de2fabf8f4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:39.014852 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f220a05e-f89e-4926-8d12-43de2fabf8f4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:39.015762 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f220a05e-f89e-4926-8d12-43de2fabf8f4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:39.016269 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f220a05e-f89e-4926-8d12-43de2fabf8f4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:39.219541 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-e9fee05e-acc5-4a5c-a604-2e10a64d0e86 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:39.230796 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-e9fee05e-acc5-4a5c-a604-2e10a64d0e86 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 200 len: 1366 microversion: 2.1 time: 0.257509 Jun 23 13:41:39.243021 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 142/299] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:38 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:39.269413 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-f220a05e-f89e-4926-8d12-43de2fabf8f4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:39.278782 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-f220a05e-f89e-4926-8d12-43de2fabf8f4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1371 microversion: 2.1 time: 0.279274 Jun 23 13:41:39.293146 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 158/300] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:38 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1371 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:39.373996 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-5bc792e1-4043-4772-afc8-f3a252c89ffa req-4a3dfaa1-b06b-497b-a998-651629460eaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0417cd02-d58c-4bd7-8847-6b817258fc3d", "tag": "8ea31764-a046-4254-ae49-a5854ff7c61e"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:41:39.391486 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-5bc792e1-4043-4772-afc8-f3a252c89ffa req-4a3dfaa1-b06b-497b-a998-651629460eaa service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:39.393479 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-5bc792e1-4043-4772-afc8-f3a252c89ffa req-4a3dfaa1-b06b-497b-a998-651629460eaa service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:39.422334 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-5bc792e1-4043-4772-afc8-f3a252c89ffa req-4a3dfaa1-b06b-497b-a998-651629460eaa service nova] Creating event network-changed:8ea31764-a046-4254-ae49-a5854ff7c61e for instance 0417cd02-d58c-4bd7-8847-6b817258fc3d on hv-cinder-81558 Jun 23 13:41:39.431624 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-5bc792e1-4043-4772-afc8-f3a252c89ffa req-4a3dfaa1-b06b-497b-a998-651629460eaa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061616 Jun 23 13:41:39.435418 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 143/301] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:41:39.825279 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-d2885317-c899-4719-b9cc-e2b868a39d29 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:39.825934 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-d2885317-c899-4719-b9cc-e2b868a39d29 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:39.834488 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d2885317-c899-4719-b9cc-e2b868a39d29 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:39.835507 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d2885317-c899-4719-b9cc-e2b868a39d29 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:39.836465 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d2885317-c899-4719-b9cc-e2b868a39d29 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:39.837053 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d2885317-c899-4719-b9cc-e2b868a39d29 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:40.035793 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-d2885317-c899-4719-b9cc-e2b868a39d29 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:40.049554 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-d2885317-c899-4719-b9cc-e2b868a39d29 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:40.052115 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-d2885317-c899-4719-b9cc-e2b868a39d29 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:40.053837 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-d2885317-c899-4719-b9cc-e2b868a39d29 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1722 microversion: 2.20 time: 0.233976 Jun 23 13:41:40.054771 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 159/302] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:41:39 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:41:40.249727 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-2e10a931-403c-4ae8-bcc3-80187b73d904 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:40.250406 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-2e10a931-403c-4ae8-bcc3-80187b73d904 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:40.257523 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2e10a931-403c-4ae8-bcc3-80187b73d904 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:40.257974 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2e10a931-403c-4ae8-bcc3-80187b73d904 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:40.259208 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2e10a931-403c-4ae8-bcc3-80187b73d904 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:40.259834 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2e10a931-403c-4ae8-bcc3-80187b73d904 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:40.298012 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-698b6ea4-c462-47b9-a1ea-94123c361952 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:40.298623 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-698b6ea4-c462-47b9-a1ea-94123c361952 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:40.306543 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-698b6ea4-c462-47b9-a1ea-94123c361952 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:40.306988 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-698b6ea4-c462-47b9-a1ea-94123c361952 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:40.307805 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-698b6ea4-c462-47b9-a1ea-94123c361952 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:40.308427 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-698b6ea4-c462-47b9-a1ea-94123c361952 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:40.479132 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-2e10a931-403c-4ae8-bcc3-80187b73d904 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:40.485256 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:40.492807 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-2e10a931-403c-4ae8-bcc3-80187b73d904 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 200 len: 1366 microversion: 2.1 time: 0.247185 Jun 23 13:41:40.494547 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 144/303] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:40 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:40.511938 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-698b6ea4-c462-47b9-a1ea-94123c361952 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:40.520016 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-698b6ea4-c462-47b9-a1ea-94123c361952 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1371 microversion: 2.1 time: 0.225840 Jun 23 13:41:40.520646 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 160/304] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:40 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1371 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:41:41.072970 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-9150867b-c59a-4b9f-8cd6-eec64cbfc8e0 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:41.073583 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-9150867b-c59a-4b9f-8cd6-eec64cbfc8e0 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:41.080696 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9150867b-c59a-4b9f-8cd6-eec64cbfc8e0 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:41.081124 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9150867b-c59a-4b9f-8cd6-eec64cbfc8e0 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:41.081985 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9150867b-c59a-4b9f-8cd6-eec64cbfc8e0 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:41.082429 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9150867b-c59a-4b9f-8cd6-eec64cbfc8e0 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:41.216614 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-9150867b-c59a-4b9f-8cd6-eec64cbfc8e0 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:41.225944 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-9150867b-c59a-4b9f-8cd6-eec64cbfc8e0 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:41.227516 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-9150867b-c59a-4b9f-8cd6-eec64cbfc8e0 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:41.228689 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-9150867b-c59a-4b9f-8cd6-eec64cbfc8e0 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1722 microversion: 2.20 time: 0.159898 Jun 23 13:41:41.229318 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 145/305] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:41:41 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:41:41.449738 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-217794be-b872-47bb-8a10-871610aa0ba9 req-9537a4e8-92b0-444c-a66a-f69ee2aba11d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb", "tag": "60ed90f0-c222-4a32-aa94-aa23838b7b54"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:41:41.458694 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-217794be-b872-47bb-8a10-871610aa0ba9 req-9537a4e8-92b0-444c-a66a-f69ee2aba11d service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:41.459266 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-217794be-b872-47bb-8a10-871610aa0ba9 req-9537a4e8-92b0-444c-a66a-f69ee2aba11d service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:41.470594 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-217794be-b872-47bb-8a10-871610aa0ba9 req-9537a4e8-92b0-444c-a66a-f69ee2aba11d service nova] Creating event network-changed:60ed90f0-c222-4a32-aa94-aa23838b7b54 for instance d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb on hv-cinder-81558 Jun 23 13:41:41.476005 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-217794be-b872-47bb-8a10-871610aa0ba9 req-9537a4e8-92b0-444c-a66a-f69ee2aba11d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029970 Jun 23 13:41:41.476722 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 161/306] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 13:41:41.510293 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-5788af6d-816c-485a-bcf5-63e57f459fac tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:41.510862 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-5788af6d-816c-485a-bcf5-63e57f459fac tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:41.517374 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5788af6d-816c-485a-bcf5-63e57f459fac tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:41.517829 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5788af6d-816c-485a-bcf5-63e57f459fac tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:41.518594 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5788af6d-816c-485a-bcf5-63e57f459fac tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:41.519029 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5788af6d-816c-485a-bcf5-63e57f459fac tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:41.538927 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-9eb7829a-9d12-43b2-a646-f38e62d9dd34 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:41.540130 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-9eb7829a-9d12-43b2-a646-f38e62d9dd34 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:41.546709 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9eb7829a-9d12-43b2-a646-f38e62d9dd34 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:41.547152 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9eb7829a-9d12-43b2-a646-f38e62d9dd34 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:41.548075 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9eb7829a-9d12-43b2-a646-f38e62d9dd34 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:41.548512 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9eb7829a-9d12-43b2-a646-f38e62d9dd34 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:41.724503 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-5788af6d-816c-485a-bcf5-63e57f459fac tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:41.731961 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-9eb7829a-9d12-43b2-a646-f38e62d9dd34 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:41.733845 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-5788af6d-816c-485a-bcf5-63e57f459fac tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 200 len: 1366 microversion: 2.1 time: 0.227510 Jun 23 13:41:41.740706 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-9eb7829a-9d12-43b2-a646-f38e62d9dd34 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1371 microversion: 2.1 time: 0.208184 Jun 23 13:41:41.741302 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 162/307] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:41 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1371 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:41.748616 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 146/308] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:41 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:42.251092 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-b5a3ec43-6113-4931-9815-cd11ebc89f5c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:42.252123 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-b5a3ec43-6113-4931-9815-cd11ebc89f5c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:42.259229 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b5a3ec43-6113-4931-9815-cd11ebc89f5c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:42.259708 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b5a3ec43-6113-4931-9815-cd11ebc89f5c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:42.260458 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b5a3ec43-6113-4931-9815-cd11ebc89f5c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:42.260910 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b5a3ec43-6113-4931-9815-cd11ebc89f5c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:42.398298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-b5a3ec43-6113-4931-9815-cd11ebc89f5c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:42.406318 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-b5a3ec43-6113-4931-9815-cd11ebc89f5c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:42.407898 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-b5a3ec43-6113-4931-9815-cd11ebc89f5c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:42.409007 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-b5a3ec43-6113-4931-9815-cd11ebc89f5c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1722 microversion: 2.20 time: 0.164429 Jun 23 13:41:42.409528 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 163/309] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:41:42 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:41:42.750794 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-51f1cbd9-1a95-4882-87d4-ce6be416b1bd tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:42.751461 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-51f1cbd9-1a95-4882-87d4-ce6be416b1bd tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:42.757785 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-1f121326-4482-47b5-80c4-4d91bb4aa4a2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:42.758312 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-51f1cbd9-1a95-4882-87d4-ce6be416b1bd tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:42.758413 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-1f121326-4482-47b5-80c4-4d91bb4aa4a2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:42.758531 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-51f1cbd9-1a95-4882-87d4-ce6be416b1bd tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:42.759291 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-51f1cbd9-1a95-4882-87d4-ce6be416b1bd tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:42.759758 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-51f1cbd9-1a95-4882-87d4-ce6be416b1bd tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:42.765170 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1f121326-4482-47b5-80c4-4d91bb4aa4a2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:42.765622 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1f121326-4482-47b5-80c4-4d91bb4aa4a2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:42.766369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1f121326-4482-47b5-80c4-4d91bb4aa4a2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:42.766797 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1f121326-4482-47b5-80c4-4d91bb4aa4a2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:42.957842 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-51f1cbd9-1a95-4882-87d4-ce6be416b1bd tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:42.962451 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-1f121326-4482-47b5-80c4-4d91bb4aa4a2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:42.966007 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-51f1cbd9-1a95-4882-87d4-ce6be416b1bd tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 200 len: 1366 microversion: 2.1 time: 0.219477 Jun 23 13:41:42.966608 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 147/310] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:42 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:42.970193 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-1f121326-4482-47b5-80c4-4d91bb4aa4a2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1371 microversion: 2.1 time: 0.216413 Jun 23 13:41:42.970739 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 164/311] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:42 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:43.429628 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-0ae5fec2-f56c-4dbc-a07d-41aa21a5074a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:43.430224 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-0ae5fec2-f56c-4dbc-a07d-41aa21a5074a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:43.436958 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0ae5fec2-f56c-4dbc-a07d-41aa21a5074a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:43.437401 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0ae5fec2-f56c-4dbc-a07d-41aa21a5074a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:43.438148 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0ae5fec2-f56c-4dbc-a07d-41aa21a5074a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:43.438580 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0ae5fec2-f56c-4dbc-a07d-41aa21a5074a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:43.569300 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-0ae5fec2-f56c-4dbc-a07d-41aa21a5074a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:43.577543 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-0ae5fec2-f56c-4dbc-a07d-41aa21a5074a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:43.579031 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-0ae5fec2-f56c-4dbc-a07d-41aa21a5074a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:43.580217 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-0ae5fec2-f56c-4dbc-a07d-41aa21a5074a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1722 microversion: 2.20 time: 0.155036 Jun 23 13:41:43.580774 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 148/312] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:41:43 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:41:43.982000 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-6c68dd09-b654-49af-b9b8-1b8c2839d944 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:43.982616 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-6c68dd09-b654-49af-b9b8-1b8c2839d944 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:43.984625 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell0:SELECT=6 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:43.986207 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:43.989416 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-3189b919-8f86-4e4b-b350-5e5a85a80ea7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:43.990138 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-3189b919-8f86-4e4b-b350-5e5a85a80ea7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:43.993853 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6c68dd09-b654-49af-b9b8-1b8c2839d944 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:43.994304 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6c68dd09-b654-49af-b9b8-1b8c2839d944 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:43.995254 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6c68dd09-b654-49af-b9b8-1b8c2839d944 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:43.995858 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6c68dd09-b654-49af-b9b8-1b8c2839d944 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:43.997961 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3189b919-8f86-4e4b-b350-5e5a85a80ea7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:43.998420 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3189b919-8f86-4e4b-b350-5e5a85a80ea7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:43.999329 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3189b919-8f86-4e4b-b350-5e5a85a80ea7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:44.000010 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3189b919-8f86-4e4b-b350-5e5a85a80ea7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:44.264406 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-3189b919-8f86-4e4b-b350-5e5a85a80ea7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:44.270194 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-6c68dd09-b654-49af-b9b8-1b8c2839d944 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:44.272324 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-3189b919-8f86-4e4b-b350-5e5a85a80ea7 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1371 microversion: 2.1 time: 0.287813 Jun 23 13:41:44.273052 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 149/313] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:43 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1371 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:41:44.279526 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-6c68dd09-b654-49af-b9b8-1b8c2839d944 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 200 len: 1366 microversion: 2.1 time: 0.301135 Jun 23 13:41:44.280089 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 165/314] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:43 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 1366 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:41:44.604729 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-995ae69a-b37f-47fc-b093-4cf7adf9e511 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:44.605730 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-995ae69a-b37f-47fc-b093-4cf7adf9e511 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:44.612858 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-995ae69a-b37f-47fc-b093-4cf7adf9e511 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:44.613788 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-995ae69a-b37f-47fc-b093-4cf7adf9e511 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:44.614572 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-995ae69a-b37f-47fc-b093-4cf7adf9e511 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:44.615251 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-995ae69a-b37f-47fc-b093-4cf7adf9e511 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:44.757612 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-995ae69a-b37f-47fc-b093-4cf7adf9e511 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:44.765642 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-995ae69a-b37f-47fc-b093-4cf7adf9e511 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:44.767126 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-995ae69a-b37f-47fc-b093-4cf7adf9e511 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:44.768304 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-995ae69a-b37f-47fc-b093-4cf7adf9e511 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1743 microversion: 2.20 time: 0.168109 Jun 23 13:41:44.768855 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 150/315] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:41:44 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1743 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:41:45.289283 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-84507c7d-27b4-4c7d-86da-cb57b1151c8a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:45.289904 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-84507c7d-27b4-4c7d-86da-cb57b1151c8a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:45.295924 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-cdea1f83-aa10-4ae2-b2fa-4eb6e1cbace6 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:45.296529 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-cdea1f83-aa10-4ae2-b2fa-4eb6e1cbace6 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:45.297270 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-84507c7d-27b4-4c7d-86da-cb57b1151c8a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:45.297720 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-84507c7d-27b4-4c7d-86da-cb57b1151c8a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:45.298483 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-84507c7d-27b4-4c7d-86da-cb57b1151c8a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:45.298913 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-84507c7d-27b4-4c7d-86da-cb57b1151c8a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:45.302786 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-cdea1f83-aa10-4ae2-b2fa-4eb6e1cbace6 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:45.303239 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-cdea1f83-aa10-4ae2-b2fa-4eb6e1cbace6 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:45.304023 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-cdea1f83-aa10-4ae2-b2fa-4eb6e1cbace6 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:45.304453 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-cdea1f83-aa10-4ae2-b2fa-4eb6e1cbace6 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:45.508767 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell0:SELECT=4 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:45.511155 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-84507c7d-27b4-4c7d-86da-cb57b1151c8a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:45.515315 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-cdea1f83-aa10-4ae2-b2fa-4eb6e1cbace6 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:45.518624 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-84507c7d-27b4-4c7d-86da-cb57b1151c8a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1371 microversion: 2.1 time: 0.233536 Jun 23 13:41:45.519199 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 166/316] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:45 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:45.523577 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-cdea1f83-aa10-4ae2-b2fa-4eb6e1cbace6 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 200 len: 1366 microversion: 2.1 time: 0.231368 Jun 23 13:41:45.524183 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 151/317] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:45 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:41:45.789107 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-98baf9bf-6755-4c3f-88be-71c8394d11f4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:45.789996 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-98baf9bf-6755-4c3f-88be-71c8394d11f4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:45.799044 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-98baf9bf-6755-4c3f-88be-71c8394d11f4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:45.799740 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-98baf9bf-6755-4c3f-88be-71c8394d11f4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:45.800819 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-98baf9bf-6755-4c3f-88be-71c8394d11f4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:45.801442 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-98baf9bf-6755-4c3f-88be-71c8394d11f4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:45.941086 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-98baf9bf-6755-4c3f-88be-71c8394d11f4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:45.944950 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=100 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:45.950921 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-98baf9bf-6755-4c3f-88be-71c8394d11f4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:45.952426 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-98baf9bf-6755-4c3f-88be-71c8394d11f4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:45.953592 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-98baf9bf-6755-4c3f-88be-71c8394d11f4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1743 microversion: 2.20 time: 0.169715 Jun 23 13:41:45.954144 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 167/318] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:41:45 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1743 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:41:46.540882 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-96d2271b-a075-4e48-92b8-c2e3844cc586 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:46.541956 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-96d2271b-a075-4e48-92b8-c2e3844cc586 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:46.542448 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-306d0592-196e-443c-be11-bb4a4dc1e820 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:46.543156 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-306d0592-196e-443c-be11-bb4a4dc1e820 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:46.544464 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell0:SELECT=18 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:46.550905 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-306d0592-196e-443c-be11-bb4a4dc1e820 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:46.551159 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-96d2271b-a075-4e48-92b8-c2e3844cc586 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:46.551371 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-306d0592-196e-443c-be11-bb4a4dc1e820 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:46.551543 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-96d2271b-a075-4e48-92b8-c2e3844cc586 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:46.552238 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-96d2271b-a075-4e48-92b8-c2e3844cc586 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:46.552381 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-306d0592-196e-443c-be11-bb4a4dc1e820 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:46.552667 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-96d2271b-a075-4e48-92b8-c2e3844cc586 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:46.552823 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-306d0592-196e-443c-be11-bb4a4dc1e820 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:46.752188 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-306d0592-196e-443c-be11-bb4a4dc1e820 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:46.756697 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-96d2271b-a075-4e48-92b8-c2e3844cc586 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:46.760674 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-306d0592-196e-443c-be11-bb4a4dc1e820 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 200 len: 1366 microversion: 2.1 time: 0.223408 Jun 23 13:41:46.761251 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 168/319] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:46 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:46.765136 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-96d2271b-a075-4e48-92b8-c2e3844cc586 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1371 microversion: 2.1 time: 0.231337 Jun 23 13:41:46.765702 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 152/320] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:46 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:46.973069 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-4df2aa4a-7c81-45a4-80d8-f3c0fffec9b9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:46.973723 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-4df2aa4a-7c81-45a4-80d8-f3c0fffec9b9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:46.980589 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4df2aa4a-7c81-45a4-80d8-f3c0fffec9b9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:46.981024 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4df2aa4a-7c81-45a4-80d8-f3c0fffec9b9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:46.981887 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4df2aa4a-7c81-45a4-80d8-f3c0fffec9b9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:46.982372 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4df2aa4a-7c81-45a4-80d8-f3c0fffec9b9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:47.115463 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-4df2aa4a-7c81-45a4-80d8-f3c0fffec9b9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:47.126247 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-4df2aa4a-7c81-45a4-80d8-f3c0fffec9b9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:47.128496 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-4df2aa4a-7c81-45a4-80d8-f3c0fffec9b9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:47.129885 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-4df2aa4a-7c81-45a4-80d8-f3c0fffec9b9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1738 microversion: 2.20 time: 0.161330 Jun 23 13:41:47.130668 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 169/321] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:41:46 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:41:47.366291 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-d84eeb35-25d3-46e5-a305-c21ea3496545 req-41849c12-7e41-458c-b6c6-55d875404afa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9ddb941-db20-4a0c-b841-d99368ad4f21", "name": "network-vif-plugged", "status": "completed", "tag": "07687dd4-8eaf-46e2-8bcb-86dc90291b87"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:41:47.370861 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:47.375271 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-d84eeb35-25d3-46e5-a305-c21ea3496545 req-41849c12-7e41-458c-b6c6-55d875404afa service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:47.375720 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-d84eeb35-25d3-46e5-a305-c21ea3496545 req-41849c12-7e41-458c-b6c6-55d875404afa service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:47.389306 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-d84eeb35-25d3-46e5-a305-c21ea3496545 req-41849c12-7e41-458c-b6c6-55d875404afa service nova] Creating event network-vif-plugged:07687dd4-8eaf-46e2-8bcb-86dc90291b87 for instance b9ddb941-db20-4a0c-b841-d99368ad4f21 on hv-cinder-81558 Jun 23 13:41:47.394217 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-d84eeb35-25d3-46e5-a305-c21ea3496545 req-41849c12-7e41-458c-b6c6-55d875404afa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031575 Jun 23 13:41:47.394752 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 153/322] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:41:47.780941 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-b91282b5-8b0c-4dc0-abea-65c0c3a6ca43 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:47.781759 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-b91282b5-8b0c-4dc0-abea-65c0c3a6ca43 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:47.791615 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-6808c434-f138-4e0b-84ef-421c32f779e3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:47.792406 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b91282b5-8b0c-4dc0-abea-65c0c3a6ca43 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:47.792612 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-6808c434-f138-4e0b-84ef-421c32f779e3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:47.792778 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b91282b5-8b0c-4dc0-abea-65c0c3a6ca43 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:47.793729 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b91282b5-8b0c-4dc0-abea-65c0c3a6ca43 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:47.794355 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b91282b5-8b0c-4dc0-abea-65c0c3a6ca43 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:47.801672 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6808c434-f138-4e0b-84ef-421c32f779e3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:47.802130 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6808c434-f138-4e0b-84ef-421c32f779e3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:47.802899 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6808c434-f138-4e0b-84ef-421c32f779e3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:47.803361 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6808c434-f138-4e0b-84ef-421c32f779e3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:48.000211 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-6808c434-f138-4e0b-84ef-421c32f779e3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:48.002549 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-b91282b5-8b0c-4dc0-abea-65c0c3a6ca43 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:48.008711 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-6808c434-f138-4e0b-84ef-421c32f779e3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1371 microversion: 2.1 time: 0.226935 Jun 23 13:41:48.009364 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 154/323] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:47 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:48.010219 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-b91282b5-8b0c-4dc0-abea-65c0c3a6ca43 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 200 len: 1366 microversion: 2.1 time: 0.235471 Jun 23 13:41:48.010780 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 170/324] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:47 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:48.148060 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-b789e98c-3b6d-4ab1-8e8a-7530e23e5dbd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:48.148668 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-b789e98c-3b6d-4ab1-8e8a-7530e23e5dbd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:48.154984 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b789e98c-3b6d-4ab1-8e8a-7530e23e5dbd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:48.155478 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b789e98c-3b6d-4ab1-8e8a-7530e23e5dbd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:48.156255 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b789e98c-3b6d-4ab1-8e8a-7530e23e5dbd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:48.156694 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b789e98c-3b6d-4ab1-8e8a-7530e23e5dbd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:48.286046 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-b789e98c-3b6d-4ab1-8e8a-7530e23e5dbd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:48.294280 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-b789e98c-3b6d-4ab1-8e8a-7530e23e5dbd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:48.295793 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-b789e98c-3b6d-4ab1-8e8a-7530e23e5dbd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:48.296948 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-b789e98c-3b6d-4ab1-8e8a-7530e23e5dbd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1738 microversion: 2.20 time: 0.152958 Jun 23 13:41:48.297506 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 155/325] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:41:48 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:41:49.025775 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-0e7de959-455b-4889-a02f-672897c2075d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:49.026508 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-0e7de959-455b-4889-a02f-672897c2075d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:49.027942 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-646420f5-0997-4e53-b1b7-217a14235e5e tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:49.028842 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-646420f5-0997-4e53-b1b7-217a14235e5e tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:49.033946 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0e7de959-455b-4889-a02f-672897c2075d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:49.034424 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0e7de959-455b-4889-a02f-672897c2075d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:49.035239 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0e7de959-455b-4889-a02f-672897c2075d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:49.035484 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-646420f5-0997-4e53-b1b7-217a14235e5e tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:49.035715 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0e7de959-455b-4889-a02f-672897c2075d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:49.035939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-646420f5-0997-4e53-b1b7-217a14235e5e tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:49.036697 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-646420f5-0997-4e53-b1b7-217a14235e5e tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:49.037126 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-646420f5-0997-4e53-b1b7-217a14235e5e tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:49.228842 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-0e7de959-455b-4889-a02f-672897c2075d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:49.234382 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-646420f5-0997-4e53-b1b7-217a14235e5e tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:49.240388 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-0e7de959-455b-4889-a02f-672897c2075d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1371 microversion: 2.1 time: 0.218399 Jun 23 13:41:49.249522 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-646420f5-0997-4e53-b1b7-217a14235e5e tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 200 len: 1366 microversion: 2.1 time: 0.225430 Jun 23 13:41:49.251182 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 171/326] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:49 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:49.252394 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 156/327] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:49 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:49.318407 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-e0b9536d-9cc8-41b4-9d31-7fe962319a55 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:49.319398 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-e0b9536d-9cc8-41b4-9d31-7fe962319a55 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:49.329192 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e0b9536d-9cc8-41b4-9d31-7fe962319a55 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:49.329897 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e0b9536d-9cc8-41b4-9d31-7fe962319a55 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:49.331141 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e0b9536d-9cc8-41b4-9d31-7fe962319a55 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:49.331934 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e0b9536d-9cc8-41b4-9d31-7fe962319a55 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:49.472061 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-e0b9536d-9cc8-41b4-9d31-7fe962319a55 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:49.480093 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-e0b9536d-9cc8-41b4-9d31-7fe962319a55 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:49.481578 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-e0b9536d-9cc8-41b4-9d31-7fe962319a55 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:49.482797 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-e0b9536d-9cc8-41b4-9d31-7fe962319a55 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1738 microversion: 2.20 time: 0.170965 Jun 23 13:41:49.483295 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 172/328] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:41:49 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:41:50.259638 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-fa941a7f-0ca8-4a91-8f92-4f8e04f90ad3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:50.260250 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-fa941a7f-0ca8-4a91-8f92-4f8e04f90ad3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:50.266844 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fa941a7f-0ca8-4a91-8f92-4f8e04f90ad3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:50.267269 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fa941a7f-0ca8-4a91-8f92-4f8e04f90ad3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:50.267856 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-1ebd4c30-4877-4d62-b0f9-b8f938358568 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:50.268371 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fa941a7f-0ca8-4a91-8f92-4f8e04f90ad3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:50.268996 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fa941a7f-0ca8-4a91-8f92-4f8e04f90ad3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:50.269112 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-1ebd4c30-4877-4d62-b0f9-b8f938358568 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:50.277656 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1ebd4c30-4877-4d62-b0f9-b8f938358568 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:50.278386 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1ebd4c30-4877-4d62-b0f9-b8f938358568 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:50.279653 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1ebd4c30-4877-4d62-b0f9-b8f938358568 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:50.280310 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1ebd4c30-4877-4d62-b0f9-b8f938358568 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:50.468606 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-1ebd4c30-4877-4d62-b0f9-b8f938358568 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:50.472531 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-fa941a7f-0ca8-4a91-8f92-4f8e04f90ad3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:50.478694 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-1ebd4c30-4877-4d62-b0f9-b8f938358568 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 200 len: 1366 microversion: 2.1 time: 0.215116 Jun 23 13:41:50.479489 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 173/329] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:50 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:50.480227 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-fa941a7f-0ca8-4a91-8f92-4f8e04f90ad3 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1371 microversion: 2.1 time: 0.224571 Jun 23 13:41:50.480786 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 157/330] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:50 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:50.506699 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-2c63c91e-52a2-40bc-b2b9-6fb72be1197c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:50.507209 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-2c63c91e-52a2-40bc-b2b9-6fb72be1197c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:50.513394 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2c63c91e-52a2-40bc-b2b9-6fb72be1197c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:50.513844 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2c63c91e-52a2-40bc-b2b9-6fb72be1197c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:50.514603 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2c63c91e-52a2-40bc-b2b9-6fb72be1197c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:50.515037 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2c63c91e-52a2-40bc-b2b9-6fb72be1197c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:50.650066 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-2c63c91e-52a2-40bc-b2b9-6fb72be1197c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:50.659905 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-2c63c91e-52a2-40bc-b2b9-6fb72be1197c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:50.661795 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-2c63c91e-52a2-40bc-b2b9-6fb72be1197c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:50.663544 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-2c63c91e-52a2-40bc-b2b9-6fb72be1197c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1738 microversion: 2.20 time: 0.160807 Jun 23 13:41:50.664260 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 174/331] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:41:50 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:41:51.495952 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-2385de87-d4f9-4ee5-83b8-36598a6fb0cb tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:51.496558 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-2385de87-d4f9-4ee5-83b8-36598a6fb0cb tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:51.497402 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-aed67fa6-c746-47dc-8dfa-45c58599729f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:51.498219 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-aed67fa6-c746-47dc-8dfa-45c58599729f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:51.502987 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2385de87-d4f9-4ee5-83b8-36598a6fb0cb tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:51.503493 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2385de87-d4f9-4ee5-83b8-36598a6fb0cb tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:51.504262 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2385de87-d4f9-4ee5-83b8-36598a6fb0cb tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:51.504652 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-aed67fa6-c746-47dc-8dfa-45c58599729f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:51.504814 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2385de87-d4f9-4ee5-83b8-36598a6fb0cb tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:51.505105 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-aed67fa6-c746-47dc-8dfa-45c58599729f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:51.505864 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-aed67fa6-c746-47dc-8dfa-45c58599729f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:51.506297 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-aed67fa6-c746-47dc-8dfa-45c58599729f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:51.707756 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-2385de87-d4f9-4ee5-83b8-36598a6fb0cb tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:51.712202 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-aed67fa6-c746-47dc-8dfa-45c58599729f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:51.715683 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-2385de87-d4f9-4ee5-83b8-36598a6fb0cb tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 200 len: 1366 microversion: 2.1 time: 0.223654 Jun 23 13:41:51.716301 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 158/332] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:51 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:51.720805 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-606af918-722d-411d-a3b2-d8480f440e88 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:51.721403 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-606af918-722d-411d-a3b2-d8480f440e88 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:51.725955 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-aed67fa6-c746-47dc-8dfa-45c58599729f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1371 microversion: 2.1 time: 0.232321 Jun 23 13:41:51.726527 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 175/333] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:51 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:51.727159 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-606af918-722d-411d-a3b2-d8480f440e88 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:51.727597 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-606af918-722d-411d-a3b2-d8480f440e88 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:51.728345 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-606af918-722d-411d-a3b2-d8480f440e88 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:51.728773 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-606af918-722d-411d-a3b2-d8480f440e88 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:51.881270 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-606af918-722d-411d-a3b2-d8480f440e88 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:51.889688 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-606af918-722d-411d-a3b2-d8480f440e88 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:51.891177 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-606af918-722d-411d-a3b2-d8480f440e88 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:51.892359 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-606af918-722d-411d-a3b2-d8480f440e88 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1738 microversion: 2.20 time: 0.175206 Jun 23 13:41:51.892916 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 159/334] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:41:51 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:41:52.733118 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-9da9d434-93a8-46ac-805e-b888598b0e42 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:52.733725 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-9da9d434-93a8-46ac-805e-b888598b0e42 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:52.742550 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9da9d434-93a8-46ac-805e-b888598b0e42 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:52.743487 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9da9d434-93a8-46ac-805e-b888598b0e42 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:52.744031 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-bd712a89-eb10-4de3-8609-10205e739c97 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:52.744838 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-bd712a89-eb10-4de3-8609-10205e739c97 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:52.745445 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9da9d434-93a8-46ac-805e-b888598b0e42 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:52.745944 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9da9d434-93a8-46ac-805e-b888598b0e42 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:52.751826 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-bd712a89-eb10-4de3-8609-10205e739c97 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:52.752273 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-bd712a89-eb10-4de3-8609-10205e739c97 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:52.753033 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-bd712a89-eb10-4de3-8609-10205e739c97 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:52.753549 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-bd712a89-eb10-4de3-8609-10205e739c97 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:52.938606 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-bd712a89-eb10-4de3-8609-10205e739c97 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:52.941478 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-9da9d434-93a8-46ac-805e-b888598b0e42 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:52.946831 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-bd712a89-eb10-4de3-8609-10205e739c97 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1371 microversion: 2.1 time: 0.208124 Jun 23 13:41:52.951494 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 160/335] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:52 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1371 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:41:52.953184 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-9da9d434-93a8-46ac-805e-b888598b0e42 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 200 len: 1366 microversion: 2.1 time: 0.224099 Jun 23 13:41:52.953886 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 176/336] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:52 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:52.957137 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-84e41276-e47a-4147-aa85-1b41d1296135 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:52.957741 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-84e41276-e47a-4147-aa85-1b41d1296135 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:52.964600 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-84e41276-e47a-4147-aa85-1b41d1296135 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:52.964986 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-84e41276-e47a-4147-aa85-1b41d1296135 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:52.965744 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-84e41276-e47a-4147-aa85-1b41d1296135 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:52.966180 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-84e41276-e47a-4147-aa85-1b41d1296135 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:53.098602 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-84e41276-e47a-4147-aa85-1b41d1296135 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:53.107042 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-84e41276-e47a-4147-aa85-1b41d1296135 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:53.108612 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-84e41276-e47a-4147-aa85-1b41d1296135 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:53.109749 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-84e41276-e47a-4147-aa85-1b41d1296135 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1738 microversion: 2.20 time: 0.156653 Jun 23 13:41:53.110305 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 161/337] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:41:52 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:41:53.964997 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-ed5412e8-084c-43bc-b8c8-7d60fef1f8e9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:53.965476 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-ed5412e8-084c-43bc-b8c8-7d60fef1f8e9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:53.970747 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-8cb2b446-618b-451b-8acf-8f6dedea8223 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:53.971377 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-8cb2b446-618b-451b-8acf-8f6dedea8223 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:53.972289 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ed5412e8-084c-43bc-b8c8-7d60fef1f8e9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:53.972737 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ed5412e8-084c-43bc-b8c8-7d60fef1f8e9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:53.973498 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ed5412e8-084c-43bc-b8c8-7d60fef1f8e9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:53.973948 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ed5412e8-084c-43bc-b8c8-7d60fef1f8e9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:53.977335 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8cb2b446-618b-451b-8acf-8f6dedea8223 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:53.977759 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8cb2b446-618b-451b-8acf-8f6dedea8223 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:53.978500 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8cb2b446-618b-451b-8acf-8f6dedea8223 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:53.978935 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8cb2b446-618b-451b-8acf-8f6dedea8223 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:53.983078 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:SELECT=100 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:54.181519 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-ed5412e8-084c-43bc-b8c8-7d60fef1f8e9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:54.189941 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-ed5412e8-084c-43bc-b8c8-7d60fef1f8e9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1371 microversion: 2.1 time: 0.229477 Jun 23 13:41:54.190685 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 177/338] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:53 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:54.199828 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-8cb2b446-618b-451b-8acf-8f6dedea8223 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:54.205679 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-8cb2b446-618b-451b-8acf-8f6dedea8223 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 200 len: 1366 microversion: 2.1 time: 0.238319 Jun 23 13:41:54.205794 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-176305a0-ecce-4fae-b07e-4c2bbad991f3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:54.206371 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-176305a0-ecce-4fae-b07e-4c2bbad991f3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:54.207677 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 162/339] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:53 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:54.212993 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-176305a0-ecce-4fae-b07e-4c2bbad991f3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:54.213678 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-176305a0-ecce-4fae-b07e-4c2bbad991f3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:54.215595 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-176305a0-ecce-4fae-b07e-4c2bbad991f3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:54.216366 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-176305a0-ecce-4fae-b07e-4c2bbad991f3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:54.377993 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-176305a0-ecce-4fae-b07e-4c2bbad991f3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:54.392397 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-176305a0-ecce-4fae-b07e-4c2bbad991f3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:54.393966 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-176305a0-ecce-4fae-b07e-4c2bbad991f3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:54.395596 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-176305a0-ecce-4fae-b07e-4c2bbad991f3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1738 microversion: 2.20 time: 0.194031 Jun 23 13:41:54.396329 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 178/340] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:41:54 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:41:55.207836 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c59a1207-05b2-47eb-a8d7-78fa131cd773 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:55.209150 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-c59a1207-05b2-47eb-a8d7-78fa131cd773 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:55.215875 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c59a1207-05b2-47eb-a8d7-78fa131cd773 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:55.216539 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c59a1207-05b2-47eb-a8d7-78fa131cd773 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:55.223850 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-5dbdb529-e728-45fb-8ee1-31581e8b574a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:55.225071 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-5dbdb529-e728-45fb-8ee1-31581e8b574a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:55.229576 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c59a1207-05b2-47eb-a8d7-78fa131cd773 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:55.230068 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c59a1207-05b2-47eb-a8d7-78fa131cd773 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:55.243955 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5dbdb529-e728-45fb-8ee1-31581e8b574a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:55.244695 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5dbdb529-e728-45fb-8ee1-31581e8b574a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:55.252354 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5dbdb529-e728-45fb-8ee1-31581e8b574a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:55.253800 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5dbdb529-e728-45fb-8ee1-31581e8b574a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:55.548160 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-c59a1207-05b2-47eb-a8d7-78fa131cd773 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:55.560059 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-c59a1207-05b2-47eb-a8d7-78fa131cd773 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1371 microversion: 2.1 time: 0.356624 Jun 23 13:41:55.569587 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-5dbdb529-e728-45fb-8ee1-31581e8b574a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:55.570408 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 163/341] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:55 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1371 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:55.572758 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-5dbdb529-e728-45fb-8ee1-31581e8b574a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 200 len: 1366 microversion: 2.1 time: 0.353750 Jun 23 13:41:55.573354 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 179/342] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:55 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 1366 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:41:55.576227 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-fb8b2de3-9de7-45c4-be5b-827d22c2503f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:55.577028 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-fb8b2de3-9de7-45c4-be5b-827d22c2503f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:55.587839 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fb8b2de3-9de7-45c4-be5b-827d22c2503f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:55.588388 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fb8b2de3-9de7-45c4-be5b-827d22c2503f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:55.589170 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fb8b2de3-9de7-45c4-be5b-827d22c2503f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:55.589607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fb8b2de3-9de7-45c4-be5b-827d22c2503f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:55.742433 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-fb8b2de3-9de7-45c4-be5b-827d22c2503f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:55.750807 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-fb8b2de3-9de7-45c4-be5b-827d22c2503f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:55.752645 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-fb8b2de3-9de7-45c4-be5b-827d22c2503f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:55.753910 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-fb8b2de3-9de7-45c4-be5b-827d22c2503f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1738 microversion: 2.20 time: 0.182299 Jun 23 13:41:55.764769 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 164/343] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:41:55 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:41:56.489836 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-af8c8510-55fd-4cce-ac60-e0aea0881b74 req-6e4a4fea-6b45-435f-ac3a-2a0ff166b2f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0417cd02-d58c-4bd7-8847-6b817258fc3d", "name": "network-vif-plugged", "status": "completed", "tag": "8ea31764-a046-4254-ae49-a5854ff7c61e"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:41:56.506092 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-af8c8510-55fd-4cce-ac60-e0aea0881b74 req-6e4a4fea-6b45-435f-ac3a-2a0ff166b2f9 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:56.506821 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-af8c8510-55fd-4cce-ac60-e0aea0881b74 req-6e4a4fea-6b45-435f-ac3a-2a0ff166b2f9 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:56.527457 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-af8c8510-55fd-4cce-ac60-e0aea0881b74 req-6e4a4fea-6b45-435f-ac3a-2a0ff166b2f9 service nova] Creating event network-vif-plugged:8ea31764-a046-4254-ae49-a5854ff7c61e for instance 0417cd02-d58c-4bd7-8847-6b817258fc3d on hv-cinder-81558 Jun 23 13:41:56.538218 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-af8c8510-55fd-4cce-ac60-e0aea0881b74 req-6e4a4fea-6b45-435f-ac3a-2a0ff166b2f9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053161 Jun 23 13:41:56.539465 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 180/344] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:41:56.594284 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-7ac68b54-9b23-4768-9b27-26c73604c471 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:56.594960 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-7ac68b54-9b23-4768-9b27-26c73604c471 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:56.615569 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-bbf1b98b-efe9-48e7-aa04-823f161391b5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:56.627777 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-bbf1b98b-efe9-48e7-aa04-823f161391b5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:56.630387 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7ac68b54-9b23-4768-9b27-26c73604c471 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:56.630872 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7ac68b54-9b23-4768-9b27-26c73604c471 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:56.636747 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7ac68b54-9b23-4768-9b27-26c73604c471 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:56.637252 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7ac68b54-9b23-4768-9b27-26c73604c471 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:56.640011 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bbf1b98b-efe9-48e7-aa04-823f161391b5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:56.644533 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bbf1b98b-efe9-48e7-aa04-823f161391b5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:56.645400 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bbf1b98b-efe9-48e7-aa04-823f161391b5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:56.647468 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bbf1b98b-efe9-48e7-aa04-823f161391b5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:56.919989 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-7ac68b54-9b23-4768-9b27-26c73604c471 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:56.941559 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-7ac68b54-9b23-4768-9b27-26c73604c471 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1371 microversion: 2.1 time: 0.367775 Jun 23 13:41:56.942349 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 165/345] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:56 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1371 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:56.960661 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-59e6d2f5-307e-490d-b4f6-cf90fca7ddba tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:56.961273 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-59e6d2f5-307e-490d-b4f6-cf90fca7ddba tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:56.972338 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-bbf1b98b-efe9-48e7-aa04-823f161391b5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:56.982950 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-59e6d2f5-307e-490d-b4f6-cf90fca7ddba tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:56.983496 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-59e6d2f5-307e-490d-b4f6-cf90fca7ddba tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:56.983631 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-bbf1b98b-efe9-48e7-aa04-823f161391b5 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 200 len: 1366 microversion: 2.1 time: 0.392524 Jun 23 13:41:56.984273 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-59e6d2f5-307e-490d-b4f6-cf90fca7ddba tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:56.984708 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-59e6d2f5-307e-490d-b4f6-cf90fca7ddba tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:56.986228 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 181/346] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:56 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 1366 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:57.207579 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-59e6d2f5-307e-490d-b4f6-cf90fca7ddba tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:57.230001 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-59e6d2f5-307e-490d-b4f6-cf90fca7ddba tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:57.233139 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-59e6d2f5-307e-490d-b4f6-cf90fca7ddba tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:57.234874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-59e6d2f5-307e-490d-b4f6-cf90fca7ddba tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1738 microversion: 2.20 time: 0.280421 Jun 23 13:41:57.235496 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 166/347] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:41:56 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1738 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:41:57.958170 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-ca60d13e-7623-42aa-8b37-ff547665be4d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:57.958792 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-ca60d13e-7623-42aa-8b37-ff547665be4d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:57.965523 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ca60d13e-7623-42aa-8b37-ff547665be4d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:57.966189 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ca60d13e-7623-42aa-8b37-ff547665be4d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:57.967117 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ca60d13e-7623-42aa-8b37-ff547665be4d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:57.967574 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ca60d13e-7623-42aa-8b37-ff547665be4d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:58.001459 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-28a16eec-91bd-4d92-9934-1cd7be75b8d9 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:58.002171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-28a16eec-91bd-4d92-9934-1cd7be75b8d9 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:58.008656 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-28a16eec-91bd-4d92-9934-1cd7be75b8d9 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:58.009105 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-28a16eec-91bd-4d92-9934-1cd7be75b8d9 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:58.009865 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-28a16eec-91bd-4d92-9934-1cd7be75b8d9 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:58.010467 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-28a16eec-91bd-4d92-9934-1cd7be75b8d9 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:58.190223 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-ca60d13e-7623-42aa-8b37-ff547665be4d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:58.205771 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-ca60d13e-7623-42aa-8b37-ff547665be4d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1371 microversion: 2.1 time: 0.250647 Jun 23 13:41:58.216662 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 182/348] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:57 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1371 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:58.231010 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-28a16eec-91bd-4d92-9934-1cd7be75b8d9 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:58.239213 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-28a16eec-91bd-4d92-9934-1cd7be75b8d9 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 200 len: 1366 microversion: 2.1 time: 0.241618 Jun 23 13:41:58.252273 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 167/349] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:57 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:41:58.267440 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-568793be-7be9-4d17-9687-7d12fdb1d2f7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:58.268172 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-568793be-7be9-4d17-9687-7d12fdb1d2f7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:58.274694 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-568793be-7be9-4d17-9687-7d12fdb1d2f7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:58.275407 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-568793be-7be9-4d17-9687-7d12fdb1d2f7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:58.276380 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-568793be-7be9-4d17-9687-7d12fdb1d2f7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:58.277009 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-568793be-7be9-4d17-9687-7d12fdb1d2f7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:58.433469 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-568793be-7be9-4d17-9687-7d12fdb1d2f7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:58.447163 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-568793be-7be9-4d17-9687-7d12fdb1d2f7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:58.449108 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-568793be-7be9-4d17-9687-7d12fdb1d2f7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:58.450285 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-568793be-7be9-4d17-9687-7d12fdb1d2f7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1738 microversion: 2.20 time: 0.198482 Jun 23 13:41:58.451024 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 183/350] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:41:58 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 13:41:58.586562 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-67d560a7-b3b1-4d6a-b738-e874907d1113 req-de9eb3f8-3a15-4a69-94cc-aa8244b902dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb", "name": "network-vif-plugged", "status": "completed", "tag": "60ed90f0-c222-4a32-aa94-aa23838b7b54"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:41:58.595219 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-67d560a7-b3b1-4d6a-b738-e874907d1113 req-de9eb3f8-3a15-4a69-94cc-aa8244b902dc service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:58.595686 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-67d560a7-b3b1-4d6a-b738-e874907d1113 req-de9eb3f8-3a15-4a69-94cc-aa8244b902dc service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:58.608820 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-67d560a7-b3b1-4d6a-b738-e874907d1113 req-de9eb3f8-3a15-4a69-94cc-aa8244b902dc service nova] Creating event network-vif-plugged:60ed90f0-c222-4a32-aa94-aa23838b7b54 for instance d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb on hv-cinder-81558 Jun 23 13:41:58.614247 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-67d560a7-b3b1-4d6a-b738-e874907d1113 req-de9eb3f8-3a15-4a69-94cc-aa8244b902dc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031820 Jun 23 13:41:58.615123 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 168/351] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 13:41:59.223787 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-18f182ca-895b-4b40-af93-f0bbd113d3d9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:59.224463 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-18f182ca-895b-4b40-af93-f0bbd113d3d9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:59.234383 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-18f182ca-895b-4b40-af93-f0bbd113d3d9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:59.234835 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-18f182ca-895b-4b40-af93-f0bbd113d3d9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:59.236080 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-18f182ca-895b-4b40-af93-f0bbd113d3d9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:59.236522 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-18f182ca-895b-4b40-af93-f0bbd113d3d9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:59.262428 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-d367af65-4598-4299-a909-e368aac91d00 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:59.263965 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-d367af65-4598-4299-a909-e368aac91d00 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:59.271483 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d367af65-4598-4299-a909-e368aac91d00 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:59.274807 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d367af65-4598-4299-a909-e368aac91d00 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:59.276074 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d367af65-4598-4299-a909-e368aac91d00 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:59.276894 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d367af65-4598-4299-a909-e368aac91d00 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:59.444166 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-18f182ca-895b-4b40-af93-f0bbd113d3d9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:59.449174 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-18f182ca-895b-4b40-af93-f0bbd113d3d9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1371 microversion: 2.1 time: 0.229339 Jun 23 13:41:59.458244 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 184/352] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:59 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:59.468911 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-201db9cc-d561-4d78-9605-f1b3cf7b1198 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:59.469541 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-201db9cc-d561-4d78-9605-f1b3cf7b1198 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:59.475639 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-201db9cc-d561-4d78-9605-f1b3cf7b1198 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:59.476089 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-201db9cc-d561-4d78-9605-f1b3cf7b1198 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:59.476847 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-201db9cc-d561-4d78-9605-f1b3cf7b1198 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:59.477277 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-201db9cc-d561-4d78-9605-f1b3cf7b1198 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:59.482304 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=100 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:41:59.486106 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-d367af65-4598-4299-a909-e368aac91d00 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:59.498190 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-d367af65-4598-4299-a909-e368aac91d00 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 200 len: 1556 microversion: 2.1 time: 0.240892 Jun 23 13:41:59.519615 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 169/353] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:41:59 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 1556 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:41:59.532068 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-b5deb41d-fd94-49c2-87d9-fc9521fbbd38 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:41:59.532712 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-b5deb41d-fd94-49c2-87d9-fc9521fbbd38 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:41:59.545116 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b5deb41d-fd94-49c2-87d9-fc9521fbbd38 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:59.550509 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b5deb41d-fd94-49c2-87d9-fc9521fbbd38 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:59.551431 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b5deb41d-fd94-49c2-87d9-fc9521fbbd38 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:41:59.552202 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b5deb41d-fd94-49c2-87d9-fc9521fbbd38 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:41:59.670109 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-201db9cc-d561-4d78-9605-f1b3cf7b1198 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:59.683741 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-201db9cc-d561-4d78-9605-f1b3cf7b1198 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:59.686999 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-201db9cc-d561-4d78-9605-f1b3cf7b1198 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:41:59.695403 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-201db9cc-d561-4d78-9605-f1b3cf7b1198 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1738 microversion: 2.20 time: 0.227298 Jun 23 13:41:59.707748 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 185/354] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:41:59 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1738 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:41:59.712817 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-b5deb41d-fd94-49c2-87d9-fc9521fbbd38 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.191784 Jun 23 13:41:59.719842 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 170/355] 10.222.0.26 () {58 vars in 1274 bytes} [Thu Jun 23 13:41:59 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d/os-interface => generated 284 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:42:00.466219 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-9461f925-b245-4a60-81a4-6949dd458b3e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:00.466832 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-9461f925-b245-4a60-81a4-6949dd458b3e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:00.480319 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9461f925-b245-4a60-81a4-6949dd458b3e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:00.480769 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9461f925-b245-4a60-81a4-6949dd458b3e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:00.481541 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9461f925-b245-4a60-81a4-6949dd458b3e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:00.482142 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9461f925-b245-4a60-81a4-6949dd458b3e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:00.712961 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-4c36dd0c-6647-4197-8d3d-24b0be604aa4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:00.713508 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-4c36dd0c-6647-4197-8d3d-24b0be604aa4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:00.720255 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4c36dd0c-6647-4197-8d3d-24b0be604aa4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:00.720965 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4c36dd0c-6647-4197-8d3d-24b0be604aa4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:00.721989 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4c36dd0c-6647-4197-8d3d-24b0be604aa4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:00.722614 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4c36dd0c-6647-4197-8d3d-24b0be604aa4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:00.737608 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-9461f925-b245-4a60-81a4-6949dd458b3e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:00.750265 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-9461f925-b245-4a60-81a4-6949dd458b3e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1371 microversion: 2.1 time: 0.287764 Jun 23 13:42:00.751986 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 186/356] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:42:00 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1371 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:42:01.025202 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-4c36dd0c-6647-4197-8d3d-24b0be604aa4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:01.033354 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-4c36dd0c-6647-4197-8d3d-24b0be604aa4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:01.035264 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-4c36dd0c-6647-4197-8d3d-24b0be604aa4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:01.036723 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-4c36dd0c-6647-4197-8d3d-24b0be604aa4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1738 microversion: 2.20 time: 0.328176 Jun 23 13:42:01.047821 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 171/357] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:00 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1738 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 13:42:01.233991 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-a95e1a04-0dbc-402f-8de9-3f75447d1374 req-e05b9758-a10a-4f1f-8997-1a767b1da76a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0417cd02-d58c-4bd7-8847-6b817258fc3d", "tag": "8ea31764-a046-4254-ae49-a5854ff7c61e"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:42:01.247501 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-a95e1a04-0dbc-402f-8de9-3f75447d1374 req-e05b9758-a10a-4f1f-8997-1a767b1da76a service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:01.248158 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-a95e1a04-0dbc-402f-8de9-3f75447d1374 req-e05b9758-a10a-4f1f-8997-1a767b1da76a service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:01.267119 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-a95e1a04-0dbc-402f-8de9-3f75447d1374 req-e05b9758-a10a-4f1f-8997-1a767b1da76a service nova] Creating event network-changed:8ea31764-a046-4254-ae49-a5854ff7c61e for instance 0417cd02-d58c-4bd7-8847-6b817258fc3d on hv-cinder-81558 Jun 23 13:42:01.273631 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-a95e1a04-0dbc-402f-8de9-3f75447d1374 req-e05b9758-a10a-4f1f-8997-1a767b1da76a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043090 Jun 23 13:42:01.275634 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 187/358] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:42:01.771694 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-6ae721ec-65d9-4780-bc55-e01daef75b9c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:01.772386 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-6ae721ec-65d9-4780-bc55-e01daef75b9c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:01.778447 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6ae721ec-65d9-4780-bc55-e01daef75b9c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:01.779164 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6ae721ec-65d9-4780-bc55-e01daef75b9c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:01.780302 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6ae721ec-65d9-4780-bc55-e01daef75b9c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:01.780802 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6ae721ec-65d9-4780-bc55-e01daef75b9c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:02.010312 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-6ae721ec-65d9-4780-bc55-e01daef75b9c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:02.018464 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-6ae721ec-65d9-4780-bc55-e01daef75b9c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1564 microversion: 2.1 time: 0.253651 Jun 23 13:42:02.025241 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 172/359] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:42:01 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1564 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:42:02.043720 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-12563097-ca2c-4448-aac1-3a98d532b1c4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:02.045049 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-12563097-ca2c-4448-aac1-3a98d532b1c4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:02.052090 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-12563097-ca2c-4448-aac1-3a98d532b1c4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:02.052882 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-12563097-ca2c-4448-aac1-3a98d532b1c4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:02.053905 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-12563097-ca2c-4448-aac1-3a98d532b1c4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:02.054404 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-12563097-ca2c-4448-aac1-3a98d532b1c4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:02.055676 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-9f72a5fd-daa6-4881-b32c-4fdf08d695a8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:02.057274 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-9f72a5fd-daa6-4881-b32c-4fdf08d695a8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:02.069721 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9f72a5fd-daa6-4881-b32c-4fdf08d695a8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:02.072453 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9f72a5fd-daa6-4881-b32c-4fdf08d695a8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:02.073503 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9f72a5fd-daa6-4881-b32c-4fdf08d695a8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:02.078012 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9f72a5fd-daa6-4881-b32c-4fdf08d695a8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:02.275619 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-12563097-ca2c-4448-aac1-3a98d532b1c4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.236740 Jun 23 13:42:02.276653 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 188/360] 10.222.0.26 () {58 vars in 1274 bytes} [Thu Jun 23 13:42:02 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb/os-interface => generated 285 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:42:02.386352 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-9f72a5fd-daa6-4881-b32c-4fdf08d695a8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:02.399576 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-9f72a5fd-daa6-4881-b32c-4fdf08d695a8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:02.401109 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-9f72a5fd-daa6-4881-b32c-4fdf08d695a8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:02.402276 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-9f72a5fd-daa6-4881-b32c-4fdf08d695a8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1738 microversion: 2.20 time: 0.352277 Jun 23 13:42:02.402837 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 173/361] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:02 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1738 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 13:42:03.424232 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-28a6cabb-a914-4b3f-8979-b6cda3ef5b9a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:03.425219 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-28a6cabb-a914-4b3f-8979-b6cda3ef5b9a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:03.442960 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-28a6cabb-a914-4b3f-8979-b6cda3ef5b9a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:03.442960 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-28a6cabb-a914-4b3f-8979-b6cda3ef5b9a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:03.442960 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-28a6cabb-a914-4b3f-8979-b6cda3ef5b9a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:03.443771 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-28a6cabb-a914-4b3f-8979-b6cda3ef5b9a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:03.694916 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-28a6cabb-a914-4b3f-8979-b6cda3ef5b9a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:03.708759 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-28a6cabb-a914-4b3f-8979-b6cda3ef5b9a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:03.708759 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-28a6cabb-a914-4b3f-8979-b6cda3ef5b9a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:03.709326 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-28a6cabb-a914-4b3f-8979-b6cda3ef5b9a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1738 microversion: 2.20 time: 0.290012 Jun 23 13:42:03.710298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 189/362] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:03 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1738 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 13:42:03.867107 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-f6b5b13e-af38-471c-88ae-397553b048be req-4e3c6f23-537b-4d0f-9955-472ee6801ffd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb", "tag": "60ed90f0-c222-4a32-aa94-aa23838b7b54"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:42:03.875531 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-f6b5b13e-af38-471c-88ae-397553b048be req-4e3c6f23-537b-4d0f-9955-472ee6801ffd service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:03.876315 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-f6b5b13e-af38-471c-88ae-397553b048be req-4e3c6f23-537b-4d0f-9955-472ee6801ffd service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:03.889088 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-f6b5b13e-af38-471c-88ae-397553b048be req-4e3c6f23-537b-4d0f-9955-472ee6801ffd service nova] Creating event network-changed:60ed90f0-c222-4a32-aa94-aa23838b7b54 for instance d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb on hv-cinder-81558 Jun 23 13:42:03.897091 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-f6b5b13e-af38-471c-88ae-397553b048be req-4e3c6f23-537b-4d0f-9955-472ee6801ffd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033417 Jun 23 13:42:03.900563 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 174/363] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:42:04.727941 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-f8ee3a7b-2a46-4f4e-a446-4977a70ac981 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:04.728666 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-f8ee3a7b-2a46-4f4e-a446-4977a70ac981 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:04.735915 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f8ee3a7b-2a46-4f4e-a446-4977a70ac981 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:04.736464 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f8ee3a7b-2a46-4f4e-a446-4977a70ac981 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:04.737310 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f8ee3a7b-2a46-4f4e-a446-4977a70ac981 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:04.737839 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f8ee3a7b-2a46-4f4e-a446-4977a70ac981 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:04.893365 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-f8ee3a7b-2a46-4f4e-a446-4977a70ac981 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:04.902048 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-f8ee3a7b-2a46-4f4e-a446-4977a70ac981 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:04.903658 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-f8ee3a7b-2a46-4f4e-a446-4977a70ac981 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:04.904970 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-f8ee3a7b-2a46-4f4e-a446-4977a70ac981 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1738 microversion: 2.20 time: 0.180900 Jun 23 13:42:04.905544 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 190/364] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:04 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:05.927164 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-9339a593-56bc-4218-b074-7a0c90cf15a8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:05.927963 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-9339a593-56bc-4218-b074-7a0c90cf15a8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:05.937299 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9339a593-56bc-4218-b074-7a0c90cf15a8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:05.937994 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9339a593-56bc-4218-b074-7a0c90cf15a8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:05.939055 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9339a593-56bc-4218-b074-7a0c90cf15a8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:05.939672 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9339a593-56bc-4218-b074-7a0c90cf15a8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:06.079734 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-9339a593-56bc-4218-b074-7a0c90cf15a8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:06.088520 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-9339a593-56bc-4218-b074-7a0c90cf15a8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:06.090008 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-9339a593-56bc-4218-b074-7a0c90cf15a8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:06.091159 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-9339a593-56bc-4218-b074-7a0c90cf15a8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1720 microversion: 2.20 time: 0.170258 Jun 23 13:42:06.091996 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 175/365] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:05 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:07.110053 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-48f057e2-0090-4b16-9853-5348b4505540 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:07.110670 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-48f057e2-0090-4b16-9853-5348b4505540 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:07.117537 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-48f057e2-0090-4b16-9853-5348b4505540 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:07.117989 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-48f057e2-0090-4b16-9853-5348b4505540 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:07.118793 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-48f057e2-0090-4b16-9853-5348b4505540 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:07.119229 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-48f057e2-0090-4b16-9853-5348b4505540 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:07.253462 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-48f057e2-0090-4b16-9853-5348b4505540 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:07.261513 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-48f057e2-0090-4b16-9853-5348b4505540 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:07.263014 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-48f057e2-0090-4b16-9853-5348b4505540 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:07.264196 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-48f057e2-0090-4b16-9853-5348b4505540 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1720 microversion: 2.20 time: 0.158140 Jun 23 13:42:07.264754 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 191/366] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:07 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:08.282061 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-4a8eb849-52eb-4b1f-aa55-68847c669bb2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:08.282668 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-4a8eb849-52eb-4b1f-aa55-68847c669bb2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:08.288942 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4a8eb849-52eb-4b1f-aa55-68847c669bb2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:08.289387 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4a8eb849-52eb-4b1f-aa55-68847c669bb2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:08.290139 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4a8eb849-52eb-4b1f-aa55-68847c669bb2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:08.290573 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4a8eb849-52eb-4b1f-aa55-68847c669bb2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:08.424846 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-4a8eb849-52eb-4b1f-aa55-68847c669bb2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:08.432937 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-4a8eb849-52eb-4b1f-aa55-68847c669bb2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:08.434421 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-4a8eb849-52eb-4b1f-aa55-68847c669bb2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:08.435617 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-4a8eb849-52eb-4b1f-aa55-68847c669bb2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1720 microversion: 2.20 time: 0.157531 Jun 23 13:42:08.436174 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 176/367] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:08 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:09.454012 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-5b65e8d1-9895-4a2d-81fd-81a91dee4abe tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:09.454608 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-5b65e8d1-9895-4a2d-81fd-81a91dee4abe tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:09.461936 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5b65e8d1-9895-4a2d-81fd-81a91dee4abe tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:09.462381 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5b65e8d1-9895-4a2d-81fd-81a91dee4abe tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:09.463131 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5b65e8d1-9895-4a2d-81fd-81a91dee4abe tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:09.463595 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5b65e8d1-9895-4a2d-81fd-81a91dee4abe tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:09.497863 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-739daa20-09b1-42a9-afd5-231511eff4a2 req-977bf0bf-d80e-46c5-8c89-a8ec95b519f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9ddb941-db20-4a0c-b841-d99368ad4f21", "name": "network-vif-unplugged", "status": "completed", "tag": "07687dd4-8eaf-46e2-8bcb-86dc90291b87"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:42:09.506717 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-739daa20-09b1-42a9-afd5-231511eff4a2 req-977bf0bf-d80e-46c5-8c89-a8ec95b519f3 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:09.507398 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-739daa20-09b1-42a9-afd5-231511eff4a2 req-977bf0bf-d80e-46c5-8c89-a8ec95b519f3 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:09.521627 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.compute.server_external_events [req-739daa20-09b1-42a9-afd5-231511eff4a2 req-977bf0bf-d80e-46c5-8c89-a8ec95b519f3 service nova] Unable to find a host for instance b9ddb941-db20-4a0c-b841-d99368ad4f21. Dropping event network-vif-unplugged {{(pid=134666) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 23 13:42:09.522620 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-739daa20-09b1-42a9-afd5-231511eff4a2 req-977bf0bf-d80e-46c5-8c89-a8ec95b519f3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028521 Jun 23 13:42:09.523785 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 177/368] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 23 13:42:09.593046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-5b65e8d1-9895-4a2d-81fd-81a91dee4abe tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:09.601431 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-5b65e8d1-9895-4a2d-81fd-81a91dee4abe tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:09.602923 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-5b65e8d1-9895-4a2d-81fd-81a91dee4abe tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:09.604189 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-5b65e8d1-9895-4a2d-81fd-81a91dee4abe tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1663 microversion: 2.20 time: 0.154150 Jun 23 13:42:09.604780 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 192/369] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:09 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:09.622971 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-908415d6-12e9-46a6-9405-de5609d710a6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c0d3e79e-9047-45a0-b782-5fa4010f5a78"}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:42:09.624055 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-908415d6-12e9-46a6-9405-de5609d710a6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:09.630756 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-908415d6-12e9-46a6-9405-de5609d710a6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:09.631248 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-908415d6-12e9-46a6-9405-de5609d710a6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:09.632072 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-908415d6-12e9-46a6-9405-de5609d710a6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:09.632495 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-908415d6-12e9-46a6-9405-de5609d710a6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:09.954803 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:09.967731 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-908415d6-12e9-46a6-9405-de5609d710a6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "POST /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.348848 Jun 23 13:42:09.968492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 178/370] 10.222.0.26 () {62 vars in 1363 bytes} [Thu Jun 23 13:42:09 2022] POST /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/os-volume_attachments => generated 188 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 13:42:10.090515 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-e8934342-9f2c-4870-ab6f-c31700c807ce tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:42:10.091140 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-e8934342-9f2c-4870-ab6f-c31700c807ce tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:10.097736 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e8934342-9f2c-4870-ab6f-c31700c807ce tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:10.098184 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e8934342-9f2c-4870-ab6f-c31700c807ce tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:10.098954 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e8934342-9f2c-4870-ab6f-c31700c807ce tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:10.099389 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e8934342-9f2c-4870-ab6f-c31700c807ce tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:10.192564 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-e8934342-9f2c-4870-ab6f-c31700c807ce tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "POST /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/action" status: 202 len: 0 microversion: 2.20 time: 0.105884 Jun 23 13:42:10.193158 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 193/371] 10.222.0.26 () {62 vars in 1318 bytes} [Thu Jun 23 13:42:10 2022] POST /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 13:42:10.201441 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-84c77cb4-cd1d-4d37-9620-b667aca69b70 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:10.202052 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-84c77cb4-cd1d-4d37-9620-b667aca69b70 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:10.209230 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-84c77cb4-cd1d-4d37-9620-b667aca69b70 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:10.209978 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-84c77cb4-cd1d-4d37-9620-b667aca69b70 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:10.210737 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-84c77cb4-cd1d-4d37-9620-b667aca69b70 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:10.211705 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-84c77cb4-cd1d-4d37-9620-b667aca69b70 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:10.346674 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-84c77cb4-cd1d-4d37-9620-b667aca69b70 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:10.360612 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-84c77cb4-cd1d-4d37-9620-b667aca69b70 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:10.362928 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-84c77cb4-cd1d-4d37-9620-b667aca69b70 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:10.364653 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-84c77cb4-cd1d-4d37-9620-b667aca69b70 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1749 microversion: 2.20 time: 0.166919 Jun 23 13:42:10.365779 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 179/372] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:10 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1749 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:11.383926 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-37b78c94-41ed-45b4-8b2a-bfcebb45101e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:11.384539 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-37b78c94-41ed-45b4-8b2a-bfcebb45101e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:11.392308 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-37b78c94-41ed-45b4-8b2a-bfcebb45101e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:11.392831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-37b78c94-41ed-45b4-8b2a-bfcebb45101e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:11.393936 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-37b78c94-41ed-45b4-8b2a-bfcebb45101e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:11.394333 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-37b78c94-41ed-45b4-8b2a-bfcebb45101e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:11.544503 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-37b78c94-41ed-45b4-8b2a-bfcebb45101e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:11.553284 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-37b78c94-41ed-45b4-8b2a-bfcebb45101e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:11.554790 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-37b78c94-41ed-45b4-8b2a-bfcebb45101e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:11.555988 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-37b78c94-41ed-45b4-8b2a-bfcebb45101e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1751 microversion: 2.20 time: 0.176596 Jun 23 13:42:11.556554 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 194/373] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:11 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:12.574093 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-9f8e01f8-509f-4460-9686-5dc2e3266050 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:12.574683 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-9f8e01f8-509f-4460-9686-5dc2e3266050 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:12.582411 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9f8e01f8-509f-4460-9686-5dc2e3266050 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:12.582875 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9f8e01f8-509f-4460-9686-5dc2e3266050 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:12.583681 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9f8e01f8-509f-4460-9686-5dc2e3266050 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:12.584145 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9f8e01f8-509f-4460-9686-5dc2e3266050 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:12.719925 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-9f8e01f8-509f-4460-9686-5dc2e3266050 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:12.729241 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-9f8e01f8-509f-4460-9686-5dc2e3266050 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:12.730751 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-9f8e01f8-509f-4460-9686-5dc2e3266050 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:12.731942 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-9f8e01f8-509f-4460-9686-5dc2e3266050 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1807 microversion: 2.20 time: 0.161891 Jun 23 13:42:12.732496 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 180/374] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:12 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:13.750464 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-7e2e0c44-8b54-478a-aab3-804b38a59b34 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:13.751717 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-7e2e0c44-8b54-478a-aab3-804b38a59b34 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:13.758648 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7e2e0c44-8b54-478a-aab3-804b38a59b34 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:13.759487 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7e2e0c44-8b54-478a-aab3-804b38a59b34 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:13.760575 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7e2e0c44-8b54-478a-aab3-804b38a59b34 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:13.761247 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7e2e0c44-8b54-478a-aab3-804b38a59b34 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:13.913198 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-7e2e0c44-8b54-478a-aab3-804b38a59b34 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:13.922555 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-7e2e0c44-8b54-478a-aab3-804b38a59b34 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:13.924291 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-7e2e0c44-8b54-478a-aab3-804b38a59b34 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:13.925556 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-7e2e0c44-8b54-478a-aab3-804b38a59b34 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1807 microversion: 2.20 time: 0.179018 Jun 23 13:42:13.926144 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 195/375] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:13 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:14.781702 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-7bd06094-6f34-4eb2-a8e3-df6115a5417d tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99bc379e-e3b0-4ce7-ac9c-3d054b339f06", "device": "/dev/sdb"}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:42:14.783432 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-7bd06094-6f34-4eb2-a8e3-df6115a5417d tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: be3d6429-ee63-4240-81e2-764a80f56740] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:14.792589 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7bd06094-6f34-4eb2-a8e3-df6115a5417d tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:14.793041 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7bd06094-6f34-4eb2-a8e3-df6115a5417d tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:14.794207 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7bd06094-6f34-4eb2-a8e3-df6115a5417d tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:14.794831 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7bd06094-6f34-4eb2-a8e3-df6115a5417d tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:14.946290 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-1b079e92-4f7a-482e-9c14-c91568fd816d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:14.946902 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-1b079e92-4f7a-482e-9c14-c91568fd816d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:14.950505 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_api:SELECT=64 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:14.955226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1b079e92-4f7a-482e-9c14-c91568fd816d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:14.955782 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1b079e92-4f7a-482e-9c14-c91568fd816d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:14.956749 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1b079e92-4f7a-482e-9c14-c91568fd816d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:14.957179 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1b079e92-4f7a-482e-9c14-c91568fd816d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:15.164986 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-1b079e92-4f7a-482e-9c14-c91568fd816d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:15.173745 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-1b079e92-4f7a-482e-9c14-c91568fd816d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:15.175285 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-1b079e92-4f7a-482e-9c14-c91568fd816d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:15.176528 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-1b079e92-4f7a-482e-9c14-c91568fd816d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1807 microversion: 2.20 time: 0.235912 Jun 23 13:42:15.177184 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 196/376] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:14 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1807 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:16.195860 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-67aed6fc-8190-4d40-b27b-d658583cb250 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:16.196553 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-67aed6fc-8190-4d40-b27b-d658583cb250 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:16.207628 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-67aed6fc-8190-4d40-b27b-d658583cb250 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:16.208338 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-67aed6fc-8190-4d40-b27b-d658583cb250 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:16.209020 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-67aed6fc-8190-4d40-b27b-d658583cb250 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:16.209769 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-67aed6fc-8190-4d40-b27b-d658583cb250 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:16.476456 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-67aed6fc-8190-4d40-b27b-d658583cb250 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:16.487809 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-67aed6fc-8190-4d40-b27b-d658583cb250 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:16.489297 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-67aed6fc-8190-4d40-b27b-d658583cb250 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:16.490474 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-67aed6fc-8190-4d40-b27b-d658583cb250 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1807 microversion: 2.20 time: 0.298939 Jun 23 13:42:16.491044 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 197/377] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:16 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1807 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:17.520372 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-472b8e78-5888-47b8-8fe9-69dc6f7cd057 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:17.521206 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-472b8e78-5888-47b8-8fe9-69dc6f7cd057 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:17.527912 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-472b8e78-5888-47b8-8fe9-69dc6f7cd057 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:17.528362 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-472b8e78-5888-47b8-8fe9-69dc6f7cd057 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:17.529141 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-472b8e78-5888-47b8-8fe9-69dc6f7cd057 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:17.529576 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-472b8e78-5888-47b8-8fe9-69dc6f7cd057 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:17.691643 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-472b8e78-5888-47b8-8fe9-69dc6f7cd057 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:17.701739 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-472b8e78-5888-47b8-8fe9-69dc6f7cd057 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:17.703230 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-472b8e78-5888-47b8-8fe9-69dc6f7cd057 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:17.704552 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-472b8e78-5888-47b8-8fe9-69dc6f7cd057 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1807 microversion: 2.20 time: 0.199821 Jun 23 13:42:17.705269 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 198/378] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:17 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1807 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 13:42:18.726827 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-5bad34f0-d484-4d86-aae9-50018268610e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:18.727605 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-5bad34f0-d484-4d86-aae9-50018268610e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:18.734985 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5bad34f0-d484-4d86-aae9-50018268610e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:18.735457 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5bad34f0-d484-4d86-aae9-50018268610e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:18.736261 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5bad34f0-d484-4d86-aae9-50018268610e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:18.736643 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5bad34f0-d484-4d86-aae9-50018268610e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:18.895760 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-5bad34f0-d484-4d86-aae9-50018268610e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:18.904963 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-5bad34f0-d484-4d86-aae9-50018268610e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:18.906539 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-5bad34f0-d484-4d86-aae9-50018268610e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:18.907815 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-5bad34f0-d484-4d86-aae9-50018268610e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1807 microversion: 2.20 time: 0.187319 Jun 23 13:42:18.908564 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 199/379] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:18 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:19.929962 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-c69e1a86-f927-4f26-8b0f-df2de355ffce tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:19.931763 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-c69e1a86-f927-4f26-8b0f-df2de355ffce tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:19.939973 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c69e1a86-f927-4f26-8b0f-df2de355ffce tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:19.950384 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c69e1a86-f927-4f26-8b0f-df2de355ffce tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:19.959685 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c69e1a86-f927-4f26-8b0f-df2de355ffce tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:19.960244 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c69e1a86-f927-4f26-8b0f-df2de355ffce tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:20.139573 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-c69e1a86-f927-4f26-8b0f-df2de355ffce tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:20.152683 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-c69e1a86-f927-4f26-8b0f-df2de355ffce tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:20.154522 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-c69e1a86-f927-4f26-8b0f-df2de355ffce tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:20.156119 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-c69e1a86-f927-4f26-8b0f-df2de355ffce tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1807 microversion: 2.20 time: 0.230831 Jun 23 13:42:20.157196 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 200/380] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:19 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1807 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:21.174406 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-755ebcb9-60b8-47a5-b40e-c69913949cb7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:21.176382 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-755ebcb9-60b8-47a5-b40e-c69913949cb7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:21.186259 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-755ebcb9-60b8-47a5-b40e-c69913949cb7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:21.190208 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-755ebcb9-60b8-47a5-b40e-c69913949cb7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:21.191207 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-755ebcb9-60b8-47a5-b40e-c69913949cb7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:21.193613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-755ebcb9-60b8-47a5-b40e-c69913949cb7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:21.396981 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-755ebcb9-60b8-47a5-b40e-c69913949cb7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:21.400800 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:21.407866 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-755ebcb9-60b8-47a5-b40e-c69913949cb7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:21.409621 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-755ebcb9-60b8-47a5-b40e-c69913949cb7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:21.411124 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-755ebcb9-60b8-47a5-b40e-c69913949cb7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1807 microversion: 2.20 time: 0.240743 Jun 23 13:42:21.412354 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 201/381] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:21 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1807 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 13:42:22.429838 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-9108352c-6495-41a6-ba44-4873d01ea91b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:22.430507 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-9108352c-6495-41a6-ba44-4873d01ea91b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:22.452517 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9108352c-6495-41a6-ba44-4873d01ea91b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:22.452988 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9108352c-6495-41a6-ba44-4873d01ea91b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:22.453787 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9108352c-6495-41a6-ba44-4873d01ea91b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:22.454229 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9108352c-6495-41a6-ba44-4873d01ea91b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:22.740748 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-9108352c-6495-41a6-ba44-4873d01ea91b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:22.756792 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-9108352c-6495-41a6-ba44-4873d01ea91b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:22.768641 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-9108352c-6495-41a6-ba44-4873d01ea91b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:22.771386 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-9108352c-6495-41a6-ba44-4873d01ea91b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1807 microversion: 2.20 time: 0.345219 Jun 23 13:42:22.776099 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 202/382] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:22 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1807 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:23.794479 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-d3ff0a0d-60be-4f9d-a014-a18471ea0db8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:23.795132 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-d3ff0a0d-60be-4f9d-a014-a18471ea0db8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:23.806164 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d3ff0a0d-60be-4f9d-a014-a18471ea0db8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:23.806954 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d3ff0a0d-60be-4f9d-a014-a18471ea0db8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:23.808075 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d3ff0a0d-60be-4f9d-a014-a18471ea0db8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:23.808823 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d3ff0a0d-60be-4f9d-a014-a18471ea0db8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:24.060334 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-d3ff0a0d-60be-4f9d-a014-a18471ea0db8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:24.070512 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-d3ff0a0d-60be-4f9d-a014-a18471ea0db8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:24.072366 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-d3ff0a0d-60be-4f9d-a014-a18471ea0db8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:24.073837 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-d3ff0a0d-60be-4f9d-a014-a18471ea0db8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1807 microversion: 2.20 time: 0.283799 Jun 23 13:42:24.074652 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 203/383] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:23 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1807 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 13:42:24.788720 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_api:SELECT=57 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:24.919776 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=18 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:25.094385 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-7207f6f7-73ca-429e-ae1e-c61fd1cd00e1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:25.095097 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-7207f6f7-73ca-429e-ae1e-c61fd1cd00e1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:25.108826 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7207f6f7-73ca-429e-ae1e-c61fd1cd00e1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:25.109283 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7207f6f7-73ca-429e-ae1e-c61fd1cd00e1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:25.110075 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7207f6f7-73ca-429e-ae1e-c61fd1cd00e1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:25.110519 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7207f6f7-73ca-429e-ae1e-c61fd1cd00e1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:25.268384 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-7207f6f7-73ca-429e-ae1e-c61fd1cd00e1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:25.277212 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-7207f6f7-73ca-429e-ae1e-c61fd1cd00e1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:25.278975 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-7207f6f7-73ca-429e-ae1e-c61fd1cd00e1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:25.280693 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-7207f6f7-73ca-429e-ae1e-c61fd1cd00e1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1807 microversion: 2.20 time: 0.190567 Jun 23 13:42:25.281476 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 204/384] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:25 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 13:42:25.487280 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-7bd06094-6f34-4eb2-a8e3-df6115a5417d tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "POST /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 10.709352 Jun 23 13:42:25.488669 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 181/385] 10.222.0.26 () {60 vars in 1322 bytes} [Thu Jun 23 13:42:14 2022] POST /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740/os-volume_attachments => generated 194 bytes in 10711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:42:26.299846 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-2ae9b369-17fa-42f7-9c29-567ff818befc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:26.300994 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-2ae9b369-17fa-42f7-9c29-567ff818befc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:26.308300 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2ae9b369-17fa-42f7-9c29-567ff818befc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:26.308920 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2ae9b369-17fa-42f7-9c29-567ff818befc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:26.309852 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2ae9b369-17fa-42f7-9c29-567ff818befc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:26.310423 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2ae9b369-17fa-42f7-9c29-567ff818befc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:26.507008 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-2ae9b369-17fa-42f7-9c29-567ff818befc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:26.530951 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-2ae9b369-17fa-42f7-9c29-567ff818befc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:26.533096 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-2ae9b369-17fa-42f7-9c29-567ff818befc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:26.535062 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-2ae9b369-17fa-42f7-9c29-567ff818befc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1807 microversion: 2.20 time: 0.239729 Jun 23 13:42:26.536212 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 205/386] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:26 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1807 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:27.554136 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c9204783-5ff4-4c53-a4bd-84d0feaf0d48 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:27.554989 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-c9204783-5ff4-4c53-a4bd-84d0feaf0d48 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:27.574858 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c9204783-5ff4-4c53-a4bd-84d0feaf0d48 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:27.576543 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c9204783-5ff4-4c53-a4bd-84d0feaf0d48 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:27.583034 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c9204783-5ff4-4c53-a4bd-84d0feaf0d48 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:27.583803 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c9204783-5ff4-4c53-a4bd-84d0feaf0d48 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:27.989382 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-c9204783-5ff4-4c53-a4bd-84d0feaf0d48 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:28.004580 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-c9204783-5ff4-4c53-a4bd-84d0feaf0d48 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:28.016002 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-c9204783-5ff4-4c53-a4bd-84d0feaf0d48 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:28.018060 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-c9204783-5ff4-4c53-a4bd-84d0feaf0d48 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1807 microversion: 2.20 time: 0.468192 Jun 23 13:42:28.023548 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 182/387] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:27 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1807 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:29.042558 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-7ad6b694-8560-4720-95ac-8458546b3670 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:29.043242 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-7ad6b694-8560-4720-95ac-8458546b3670 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:29.056621 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7ad6b694-8560-4720-95ac-8458546b3670 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:29.057514 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7ad6b694-8560-4720-95ac-8458546b3670 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:29.058545 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7ad6b694-8560-4720-95ac-8458546b3670 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:29.060937 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7ad6b694-8560-4720-95ac-8458546b3670 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:29.314843 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-7ad6b694-8560-4720-95ac-8458546b3670 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:29.325943 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-7ad6b694-8560-4720-95ac-8458546b3670 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:29.328058 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-7ad6b694-8560-4720-95ac-8458546b3670 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:29.329636 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-7ad6b694-8560-4720-95ac-8458546b3670 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1807 microversion: 2.20 time: 0.292387 Jun 23 13:42:29.330791 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 206/388] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:29 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1807 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:30.348741 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-0884f665-ca67-400e-b005-ac4098001eab tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:30.349356 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-0884f665-ca67-400e-b005-ac4098001eab tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:30.357551 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0884f665-ca67-400e-b005-ac4098001eab tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:30.359122 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0884f665-ca67-400e-b005-ac4098001eab tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:30.360658 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0884f665-ca67-400e-b005-ac4098001eab tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:30.361314 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0884f665-ca67-400e-b005-ac4098001eab tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:31.032129 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-0884f665-ca67-400e-b005-ac4098001eab tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:31.042971 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-0884f665-ca67-400e-b005-ac4098001eab tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:31.056684 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-0884f665-ca67-400e-b005-ac4098001eab tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:31.061581 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-0884f665-ca67-400e-b005-ac4098001eab tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1807 microversion: 2.20 time: 0.713674 Jun 23 13:42:31.075533 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 183/389] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:30 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1807 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:32.081534 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-016c0830-d96f-4dc4-8b7d-147713a85fb0 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:32.082137 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-016c0830-d96f-4dc4-8b7d-147713a85fb0 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:32.099715 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-016c0830-d96f-4dc4-8b7d-147713a85fb0 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:32.100167 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-016c0830-d96f-4dc4-8b7d-147713a85fb0 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:32.100944 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-016c0830-d96f-4dc4-8b7d-147713a85fb0 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:32.101373 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-016c0830-d96f-4dc4-8b7d-147713a85fb0 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:32.401847 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-016c0830-d96f-4dc4-8b7d-147713a85fb0 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:32.410885 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-016c0830-d96f-4dc4-8b7d-147713a85fb0 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:32.424686 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-016c0830-d96f-4dc4-8b7d-147713a85fb0 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:32.426327 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-016c0830-d96f-4dc4-8b7d-147713a85fb0 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1807 microversion: 2.20 time: 0.348416 Jun 23 13:42:32.427121 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 207/390] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:32 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1807 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:33.445494 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-5c69d999-26eb-4db6-959c-94251157ef0c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:33.447402 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-5c69d999-26eb-4db6-959c-94251157ef0c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:33.457066 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5c69d999-26eb-4db6-959c-94251157ef0c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:33.459447 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5c69d999-26eb-4db6-959c-94251157ef0c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:33.462010 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5c69d999-26eb-4db6-959c-94251157ef0c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:33.463010 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5c69d999-26eb-4db6-959c-94251157ef0c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:33.813789 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-5c69d999-26eb-4db6-959c-94251157ef0c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:33.831141 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-5c69d999-26eb-4db6-959c-94251157ef0c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:33.832685 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-5c69d999-26eb-4db6-959c-94251157ef0c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:33.833882 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-5c69d999-26eb-4db6-959c-94251157ef0c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1807 microversion: 2.20 time: 0.393631 Jun 23 13:42:33.834765 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 184/391] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:33 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1807 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:34.858015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-38a956fc-3ea1-421d-9f22-622b24e5c6bc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:34.859122 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-38a956fc-3ea1-421d-9f22-622b24e5c6bc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:34.876022 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-38a956fc-3ea1-421d-9f22-622b24e5c6bc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:34.878200 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-38a956fc-3ea1-421d-9f22-622b24e5c6bc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:34.878200 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-38a956fc-3ea1-421d-9f22-622b24e5c6bc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:34.878656 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-38a956fc-3ea1-421d-9f22-622b24e5c6bc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:35.140153 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-38a956fc-3ea1-421d-9f22-622b24e5c6bc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:35.162236 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-38a956fc-3ea1-421d-9f22-622b24e5c6bc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:35.173432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-38a956fc-3ea1-421d-9f22-622b24e5c6bc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:35.174222 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-38a956fc-3ea1-421d-9f22-622b24e5c6bc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1807 microversion: 2.20 time: 0.322890 Jun 23 13:42:35.182083 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 208/392] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:34 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1807 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:36.200164 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-97d2eab5-40da-49ca-bc0b-fd88b2b1de18 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:36.200767 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-97d2eab5-40da-49ca-bc0b-fd88b2b1de18 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:36.212158 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-97d2eab5-40da-49ca-bc0b-fd88b2b1de18 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:36.212610 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-97d2eab5-40da-49ca-bc0b-fd88b2b1de18 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:36.213383 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-97d2eab5-40da-49ca-bc0b-fd88b2b1de18 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:36.213815 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-97d2eab5-40da-49ca-bc0b-fd88b2b1de18 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:36.425475 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-97d2eab5-40da-49ca-bc0b-fd88b2b1de18 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:36.437368 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-97d2eab5-40da-49ca-bc0b-fd88b2b1de18 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:36.439198 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-97d2eab5-40da-49ca-bc0b-fd88b2b1de18 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:36.440605 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-97d2eab5-40da-49ca-bc0b-fd88b2b1de18 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1807 microversion: 2.20 time: 0.244530 Jun 23 13:42:36.441637 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 185/393] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:36 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1807 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:37.461137 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-2a207a67-f3ab-471f-b7fe-cec92b28b875 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:37.462356 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-2a207a67-f3ab-471f-b7fe-cec92b28b875 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:37.490517 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2a207a67-f3ab-471f-b7fe-cec92b28b875 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:37.491465 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2a207a67-f3ab-471f-b7fe-cec92b28b875 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:37.494178 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2a207a67-f3ab-471f-b7fe-cec92b28b875 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:37.496000 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2a207a67-f3ab-471f-b7fe-cec92b28b875 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:38.313961 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-2a207a67-f3ab-471f-b7fe-cec92b28b875 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:38.331265 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-2a207a67-f3ab-471f-b7fe-cec92b28b875 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:38.335827 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-2a207a67-f3ab-471f-b7fe-cec92b28b875 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:38.342431 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-2a207a67-f3ab-471f-b7fe-cec92b28b875 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1807 microversion: 2.20 time: 0.887123 Jun 23 13:42:38.343025 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 209/394] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:37 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1807 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:39.375835 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-40b9b577-a2ff-47ba-a9cc-a98ed220fbbe tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:39.376633 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-40b9b577-a2ff-47ba-a9cc-a98ed220fbbe tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:39.390490 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-40b9b577-a2ff-47ba-a9cc-a98ed220fbbe tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:39.397441 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-40b9b577-a2ff-47ba-a9cc-a98ed220fbbe tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:39.399673 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-40b9b577-a2ff-47ba-a9cc-a98ed220fbbe tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:39.401801 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-40b9b577-a2ff-47ba-a9cc-a98ed220fbbe tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:40.385547 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-40b9b577-a2ff-47ba-a9cc-a98ed220fbbe tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:40.402477 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-40b9b577-a2ff-47ba-a9cc-a98ed220fbbe tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:40.406151 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-40b9b577-a2ff-47ba-a9cc-a98ed220fbbe tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:40.427039 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-40b9b577-a2ff-47ba-a9cc-a98ed220fbbe tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1807 microversion: 2.20 time: 1.056191 Jun 23 13:42:40.428885 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 186/395] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:39 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1807 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:41.448545 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-36b1b2c3-38d3-48ed-a465-68b6d1c183b5 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:41.450029 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-36b1b2c3-38d3-48ed-a465-68b6d1c183b5 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:41.461924 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-36b1b2c3-38d3-48ed-a465-68b6d1c183b5 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:41.462678 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-36b1b2c3-38d3-48ed-a465-68b6d1c183b5 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:41.464359 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-36b1b2c3-38d3-48ed-a465-68b6d1c183b5 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:41.465000 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-36b1b2c3-38d3-48ed-a465-68b6d1c183b5 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:41.722232 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-36b1b2c3-38d3-48ed-a465-68b6d1c183b5 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:41.741275 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-36b1b2c3-38d3-48ed-a465-68b6d1c183b5 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:41.743115 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-36b1b2c3-38d3-48ed-a465-68b6d1c183b5 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:41.744517 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-36b1b2c3-38d3-48ed-a465-68b6d1c183b5 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1807 microversion: 2.20 time: 0.302420 Jun 23 13:42:41.755766 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 210/396] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:41 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1807 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:42.763604 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-59145af5-fa1b-40ae-ae86-4da6d2f5058b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:42.764851 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-59145af5-fa1b-40ae-ae86-4da6d2f5058b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:42.776810 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-59145af5-fa1b-40ae-ae86-4da6d2f5058b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:42.777575 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-59145af5-fa1b-40ae-ae86-4da6d2f5058b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:42.779673 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-59145af5-fa1b-40ae-ae86-4da6d2f5058b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:42.781004 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-59145af5-fa1b-40ae-ae86-4da6d2f5058b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:43.063202 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-59145af5-fa1b-40ae-ae86-4da6d2f5058b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:43.076352 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-59145af5-fa1b-40ae-ae86-4da6d2f5058b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:43.078273 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-59145af5-fa1b-40ae-ae86-4da6d2f5058b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:43.098589 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-59145af5-fa1b-40ae-ae86-4da6d2f5058b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1807 microversion: 2.20 time: 0.338916 Jun 23 13:42:43.099516 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 187/397] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:42 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1807 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:44.058867 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-854bfdbb-24a0-4775-937f-f415564e7ae8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Action: 'create', calling method: .version_select at 0x7fd77245c820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1938430720", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdVCPiAaTzbCzzvn8bpXt/hpFHuQJOfXTMGHiFrJuPQh1ulMPN86pCREqpQXI3FBfrvyaZOSeBHy8jyX/npxXOdh4tzh8Fd4mhaMGfWVb0zJvk1+d0sIbAZN6VRLKIxxg=="}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:42:44.085359 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.quota [None req-854bfdbb-24a0-4775-937f-f415564e7ae8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Getting quotas for project 0d6c438e59834c4084c818053e1fdb93. Resources: {'key_pairs'} {{(pid=134667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:42:44.095076 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.quota [None req-854bfdbb-24a0-4775-937f-f415564e7ae8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Getting quotas for user 0a9f85caf65f431c96f27a7d04734211 and project 0d6c438e59834c4084c818053e1fdb93. Resources: {'key_pairs'} {{(pid=134667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:42:44.118503 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-8fc5a84c-19d6-4664-86ba-4d6464048055 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:44.119728 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-8fc5a84c-19d6-4664-86ba-4d6464048055 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:44.130528 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8fc5a84c-19d6-4664-86ba-4d6464048055 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:44.131550 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8fc5a84c-19d6-4664-86ba-4d6464048055 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:44.133734 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8fc5a84c-19d6-4664-86ba-4d6464048055 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:44.134636 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8fc5a84c-19d6-4664-86ba-4d6464048055 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:44.154346 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-854bfdbb-24a0-4775-937f-f415564e7ae8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.341705 Jun 23 13:42:44.159792 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 211/398] 10.222.0.26 () {60 vars in 1158 bytes} [Thu Jun 23 13:42:43 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:42:44.394518 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-1660e792-88bf-495f-8a71-fdafc8e3895b req-a79954f3-c32e-484b-816b-b00110b5a8a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9ddb941-db20-4a0c-b841-d99368ad4f21", "name": "network-vif-plugged", "status": "completed", "tag": "07687dd4-8eaf-46e2-8bcb-86dc90291b87"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:42:44.411866 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-1660e792-88bf-495f-8a71-fdafc8e3895b req-a79954f3-c32e-484b-816b-b00110b5a8a9 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:44.412146 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-1660e792-88bf-495f-8a71-fdafc8e3895b req-a79954f3-c32e-484b-816b-b00110b5a8a9 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:44.438960 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-1660e792-88bf-495f-8a71-fdafc8e3895b req-a79954f3-c32e-484b-816b-b00110b5a8a9 service nova] Creating event network-vif-plugged:07687dd4-8eaf-46e2-8bcb-86dc90291b87 for instance b9ddb941-db20-4a0c-b841-d99368ad4f21 on hv-cinder-81558 Jun 23 13:42:44.460849 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-1660e792-88bf-495f-8a71-fdafc8e3895b req-a79954f3-c32e-484b-816b-b00110b5a8a9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070006 Jun 23 13:42:44.461717 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 212/399] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 13:42:44.486375 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-8fc5a84c-19d6-4664-86ba-4d6464048055 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:44.503634 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-8fc5a84c-19d6-4664-86ba-4d6464048055 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:44.505838 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-8fc5a84c-19d6-4664-86ba-4d6464048055 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:44.509272 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-8fc5a84c-19d6-4664-86ba-4d6464048055 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1807 microversion: 2.20 time: 0.395627 Jun 23 13:42:44.509972 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 188/400] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:44 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1807 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:45.529724 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-b622a52c-7051-4150-975b-b74c73314ee2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:45.531254 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-b622a52c-7051-4150-975b-b74c73314ee2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:45.536890 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:45.546247 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b622a52c-7051-4150-975b-b74c73314ee2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:45.547396 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b622a52c-7051-4150-975b-b74c73314ee2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:45.549097 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b622a52c-7051-4150-975b-b74c73314ee2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:45.549889 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b622a52c-7051-4150-975b-b74c73314ee2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:45.758287 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-b622a52c-7051-4150-975b-b74c73314ee2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:45.768561 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-b622a52c-7051-4150-975b-b74c73314ee2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:45.770315 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-b622a52c-7051-4150-975b-b74c73314ee2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:45.771773 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-b622a52c-7051-4150-975b-b74c73314ee2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1807 microversion: 2.20 time: 0.247020 Jun 23 13:42:45.772876 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 213/401] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:45 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1807 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:45.978694 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-2f3ff183-ddc5-4b91-8070-2e94e57237cb tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Action: 'create', calling method: .version_select at 0x7fd7724ee790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-960239118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEr4c23/Z6b7cp9+9xa9RDN1AOYmqminH0XstSM3TqAhp2hGKwS9u1KM/LVdDIFj1sCMe+pPHMpmMUuDFUalBzYBduo+stbwjlVM81+gsQMElD/jS47g8Vye7PeapYBAdQ=="}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:42:45.996262 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-2f3ff183-ddc5-4b91-8070-2e94e57237cb tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Getting quotas for project 28b455b8dd8b4910803ac509413a97e6. Resources: {'key_pairs'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:42:46.000513 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-2f3ff183-ddc5-4b91-8070-2e94e57237cb tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Getting quotas for user 157d5f6570024c468db34ae0ca7ad622 and project 28b455b8dd8b4910803ac509413a97e6. Resources: {'key_pairs'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:42:46.025581 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-2f3ff183-ddc5-4b91-8070-2e94e57237cb tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.051027 Jun 23 13:42:46.026563 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 189/402] 10.222.0.26 () {60 vars in 1158 bytes} [Thu Jun 23 13:42:45 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:42:46.137327 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-ac62a961-1785-4401-ab5b-2ba7ecc6fe7b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-499155242", "imageRef": "962119b3-8255-40c1-a516-54a5c02652fe", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-960239118", "networks": [{"uuid": "500fbded-0db2-4c63-b1ff-d4d5b022ae43"}]}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:42:46.197180 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.network.neutron [None req-ac62a961-1785-4401-ab5b-2ba7ecc6fe7b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] validate_networks() for [('500fbded-0db2-4c63-b1ff-d4d5b022ae43', None, None, None, None, None)] {{(pid=134667) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 13:42:46.601435 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-ac62a961-1785-4401-ab5b-2ba7ecc6fe7b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Flavor limits 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 13:42:46.602023 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-ac62a961-1785-4401-ab5b-2ba7ecc6fe7b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Image limits 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 13:42:46.602339 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-ac62a961-1785-4401-ab5b-2ba7ecc6fe7b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Flavor pref 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 13:42:46.602748 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-ac62a961-1785-4401-ab5b-2ba7ecc6fe7b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Image pref 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 13:42:46.603148 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-ac62a961-1785-4401-ab5b-2ba7ecc6fe7b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 13:42:46.612769 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ac62a961-1785-4401-ab5b-2ba7ecc6fe7b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:46.613207 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ac62a961-1785-4401-ab5b-2ba7ecc6fe7b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:46.613984 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ac62a961-1785-4401-ab5b-2ba7ecc6fe7b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:46.614412 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ac62a961-1785-4401-ab5b-2ba7ecc6fe7b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:46.631630 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.quota [None req-ac62a961-1785-4401-ab5b-2ba7ecc6fe7b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Getting quotas for project 28b455b8dd8b4910803ac509413a97e6. Resources: {'ram', 'cores', 'instances'} {{(pid=134667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:42:46.638254 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.quota [None req-ac62a961-1785-4401-ab5b-2ba7ecc6fe7b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Getting quotas for user 157d5f6570024c468db34ae0ca7ad622 and project 28b455b8dd8b4910803ac509413a97e6. Resources: {'ram', 'cores', 'instances'} {{(pid=134667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:42:46.650127 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-ac62a961-1785-4401-ab5b-2ba7ecc6fe7b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Going to run 1 instances... {{(pid=134667) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 13:42:46.652400 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-ac62a961-1785-4401-ab5b-2ba7ecc6fe7b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='962119b3-8255-40c1-a516-54a5c02652fe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134667) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 13:42:46.700385 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-ac62a961-1785-4401-ab5b-2ba7ecc6fe7b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.566828 Jun 23 13:42:46.700943 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 214/403] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Jun 23 13:42:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 13:42:46.711427 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-18e923b8-629a-4b9f-bead-44fcc13c0ff4 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:46.712319 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-18e923b8-629a-4b9f-bead-44fcc13c0ff4 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:46.767223 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-18e923b8-629a-4b9f-bead-44fcc13c0ff4 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:46.774455 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-18e923b8-629a-4b9f-bead-44fcc13c0ff4 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1257 microversion: 2.1 time: 0.067100 Jun 23 13:42:46.775006 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 190/404] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:42:46 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1257 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:42:46.790021 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-3a2023d2-82fd-4094-8f09-66b3e9494809 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:46.790623 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-3a2023d2-82fd-4094-8f09-66b3e9494809 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:46.796755 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3a2023d2-82fd-4094-8f09-66b3e9494809 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:46.797233 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3a2023d2-82fd-4094-8f09-66b3e9494809 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:46.797928 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3a2023d2-82fd-4094-8f09-66b3e9494809 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:46.798418 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3a2023d2-82fd-4094-8f09-66b3e9494809 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:46.938154 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-3a2023d2-82fd-4094-8f09-66b3e9494809 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:46.948547 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-3a2023d2-82fd-4094-8f09-66b3e9494809 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:46.950070 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-3a2023d2-82fd-4094-8f09-66b3e9494809 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:46.951304 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-3a2023d2-82fd-4094-8f09-66b3e9494809 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1807 microversion: 2.20 time: 0.165178 Jun 23 13:42:46.951836 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 215/405] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:46 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:47.792031 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-6e406432-2e96-4501-b430-96bb0fd61fe0 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:47.793347 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-6e406432-2e96-4501-b430-96bb0fd61fe0 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:47.802347 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6e406432-2e96-4501-b430-96bb0fd61fe0 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:47.802797 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6e406432-2e96-4501-b430-96bb0fd61fe0 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:47.803594 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6e406432-2e96-4501-b430-96bb0fd61fe0 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:47.804025 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6e406432-2e96-4501-b430-96bb0fd61fe0 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:47.881411 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-6e406432-2e96-4501-b430-96bb0fd61fe0 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:47.894251 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-6e406432-2e96-4501-b430-96bb0fd61fe0 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1261 microversion: 2.1 time: 0.106298 Jun 23 13:42:47.894845 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 191/406] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:42:47 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1261 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:42:47.970145 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-53f470a7-0b85-47e7-b37f-2a1d7e4ffbbb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:47.971147 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-53f470a7-0b85-47e7-b37f-2a1d7e4ffbbb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:47.978177 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-53f470a7-0b85-47e7-b37f-2a1d7e4ffbbb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:47.978631 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-53f470a7-0b85-47e7-b37f-2a1d7e4ffbbb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:47.979437 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-53f470a7-0b85-47e7-b37f-2a1d7e4ffbbb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:47.979880 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-53f470a7-0b85-47e7-b37f-2a1d7e4ffbbb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:48.118048 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-53f470a7-0b85-47e7-b37f-2a1d7e4ffbbb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:48.127322 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-53f470a7-0b85-47e7-b37f-2a1d7e4ffbbb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:48.129036 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-53f470a7-0b85-47e7-b37f-2a1d7e4ffbbb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:48.130209 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-53f470a7-0b85-47e7-b37f-2a1d7e4ffbbb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1807 microversion: 2.20 time: 0.164317 Jun 23 13:42:48.130775 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 216/407] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:47 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:48.911554 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-78ddf297-3c41-43e8-903e-977cdf2fef71 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:48.912468 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-78ddf297-3c41-43e8-903e-977cdf2fef71 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:48.920994 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-78ddf297-3c41-43e8-903e-977cdf2fef71 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:48.920994 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-78ddf297-3c41-43e8-903e-977cdf2fef71 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:48.923008 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-78ddf297-3c41-43e8-903e-977cdf2fef71 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:48.923767 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-78ddf297-3c41-43e8-903e-977cdf2fef71 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:48.993168 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-78ddf297-3c41-43e8-903e-977cdf2fef71 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:49.002408 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-78ddf297-3c41-43e8-903e-977cdf2fef71 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1261 microversion: 2.1 time: 0.094949 Jun 23 13:42:49.002990 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 192/408] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:42:48 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1261 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:42:49.148899 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-4037e879-5832-4d21-88d9-abf976017448 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:49.149674 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-4037e879-5832-4d21-88d9-abf976017448 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:49.156520 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4037e879-5832-4d21-88d9-abf976017448 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:49.156963 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4037e879-5832-4d21-88d9-abf976017448 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:49.157805 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4037e879-5832-4d21-88d9-abf976017448 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:49.158212 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4037e879-5832-4d21-88d9-abf976017448 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:49.300905 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-4037e879-5832-4d21-88d9-abf976017448 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:49.310593 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-4037e879-5832-4d21-88d9-abf976017448 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:49.312487 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-4037e879-5832-4d21-88d9-abf976017448 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:49.313898 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-4037e879-5832-4d21-88d9-abf976017448 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1807 microversion: 2.20 time: 0.169037 Jun 23 13:42:49.314458 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 217/409] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:49 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:50.019588 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-e74f404c-d365-4aee-9e86-1a9deeca003f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:50.020553 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-e74f404c-d365-4aee-9e86-1a9deeca003f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:50.028880 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e74f404c-d365-4aee-9e86-1a9deeca003f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:50.029689 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e74f404c-d365-4aee-9e86-1a9deeca003f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:50.030939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e74f404c-d365-4aee-9e86-1a9deeca003f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:50.031374 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e74f404c-d365-4aee-9e86-1a9deeca003f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:50.095681 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-e74f404c-d365-4aee-9e86-1a9deeca003f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:50.104359 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-e74f404c-d365-4aee-9e86-1a9deeca003f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1261 microversion: 2.1 time: 0.089764 Jun 23 13:42:50.105376 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 193/410] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:42:50 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1261 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:42:50.331543 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-7edff250-0255-4ce2-9ca1-6ff9ba873d63 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:50.332277 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-7edff250-0255-4ce2-9ca1-6ff9ba873d63 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:50.340051 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7edff250-0255-4ce2-9ca1-6ff9ba873d63 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:50.340767 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7edff250-0255-4ce2-9ca1-6ff9ba873d63 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:50.341745 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7edff250-0255-4ce2-9ca1-6ff9ba873d63 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:50.342360 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7edff250-0255-4ce2-9ca1-6ff9ba873d63 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:50.481141 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-7edff250-0255-4ce2-9ca1-6ff9ba873d63 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:50.490164 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-7edff250-0255-4ce2-9ca1-6ff9ba873d63 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:50.491728 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-7edff250-0255-4ce2-9ca1-6ff9ba873d63 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:50.492901 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-7edff250-0255-4ce2-9ca1-6ff9ba873d63 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1807 microversion: 2.20 time: 0.165506 Jun 23 13:42:50.493488 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 218/411] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:50 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:51.122057 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-b6b2a63b-3692-4092-b90e-dabeb962c93b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:51.122709 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-b6b2a63b-3692-4092-b90e-dabeb962c93b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:51.129567 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b6b2a63b-3692-4092-b90e-dabeb962c93b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:51.129986 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b6b2a63b-3692-4092-b90e-dabeb962c93b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:51.130760 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b6b2a63b-3692-4092-b90e-dabeb962c93b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:51.131192 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b6b2a63b-3692-4092-b90e-dabeb962c93b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:51.200634 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-b6b2a63b-3692-4092-b90e-dabeb962c93b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:51.208552 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-b6b2a63b-3692-4092-b90e-dabeb962c93b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1309 microversion: 2.1 time: 0.090455 Jun 23 13:42:51.209427 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 194/412] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:42:51 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1309 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:42:51.511369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-3bb302db-cf51-4588-b81c-1a7797debf7d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:51.512175 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-3bb302db-cf51-4588-b81c-1a7797debf7d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:51.518736 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3bb302db-cf51-4588-b81c-1a7797debf7d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:51.519189 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3bb302db-cf51-4588-b81c-1a7797debf7d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:51.520025 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3bb302db-cf51-4588-b81c-1a7797debf7d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:51.520465 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3bb302db-cf51-4588-b81c-1a7797debf7d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:51.654321 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-3bb302db-cf51-4588-b81c-1a7797debf7d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:51.663456 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-3bb302db-cf51-4588-b81c-1a7797debf7d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:51.665016 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-3bb302db-cf51-4588-b81c-1a7797debf7d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:51.666187 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-3bb302db-cf51-4588-b81c-1a7797debf7d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1807 microversion: 2.20 time: 0.158759 Jun 23 13:42:51.666789 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 219/413] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:51 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:52.226607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-7e42507d-7a09-4dae-93a5-5cd0c142d5cb tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:52.227329 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-7e42507d-7a09-4dae-93a5-5cd0c142d5cb tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:52.233880 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7e42507d-7a09-4dae-93a5-5cd0c142d5cb tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:52.234564 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7e42507d-7a09-4dae-93a5-5cd0c142d5cb tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:52.235325 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7e42507d-7a09-4dae-93a5-5cd0c142d5cb tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:52.236028 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7e42507d-7a09-4dae-93a5-5cd0c142d5cb tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:52.304841 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-7e42507d-7a09-4dae-93a5-5cd0c142d5cb tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:52.326186 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-7e42507d-7a09-4dae-93a5-5cd0c142d5cb tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1315 microversion: 2.1 time: 0.103297 Jun 23 13:42:52.327282 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 195/414] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:42:52 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1315 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:42:52.686314 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-9abe08b1-b3f0-4f30-b4a6-9d38682ea241 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:52.686925 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-9abe08b1-b3f0-4f30-b4a6-9d38682ea241 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:52.695463 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9abe08b1-b3f0-4f30-b4a6-9d38682ea241 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:52.696178 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9abe08b1-b3f0-4f30-b4a6-9d38682ea241 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:52.697014 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9abe08b1-b3f0-4f30-b4a6-9d38682ea241 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:52.697453 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9abe08b1-b3f0-4f30-b4a6-9d38682ea241 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:52.702105 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=95 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:52.921821 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-9abe08b1-b3f0-4f30-b4a6-9d38682ea241 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:52.931827 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-9abe08b1-b3f0-4f30-b4a6-9d38682ea241 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:52.933599 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-9abe08b1-b3f0-4f30-b4a6-9d38682ea241 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:52.934962 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-9abe08b1-b3f0-4f30-b4a6-9d38682ea241 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1807 microversion: 2.20 time: 0.254010 Jun 23 13:42:52.948711 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 220/415] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:52 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1807 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:53.345887 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-11190d1f-f4d2-4df2-ae07-ba2a30f51c1f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:53.346512 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-11190d1f-f4d2-4df2-ae07-ba2a30f51c1f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:53.353910 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-11190d1f-f4d2-4df2-ae07-ba2a30f51c1f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:53.354647 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-11190d1f-f4d2-4df2-ae07-ba2a30f51c1f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:53.355602 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-11190d1f-f4d2-4df2-ae07-ba2a30f51c1f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:53.356180 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-11190d1f-f4d2-4df2-ae07-ba2a30f51c1f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:53.588738 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-11190d1f-f4d2-4df2-ae07-ba2a30f51c1f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:53.600039 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-11190d1f-f4d2-4df2-ae07-ba2a30f51c1f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1357 microversion: 2.1 time: 0.256431 Jun 23 13:42:53.609888 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 196/416] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:42:53 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1357 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:42:53.732315 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-d500b686-c4b6-45b9-b453-63a9fa8a5a39 req-c6bc19b6-495d-4388-a7b7-ffd3f9a068d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01f7b0a9-1671-460d-8a52-541dc119c6f6", "tag": "f801c0fd-febc-4835-97ee-811b19175e3e"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:42:53.745347 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-d500b686-c4b6-45b9-b453-63a9fa8a5a39 req-c6bc19b6-495d-4388-a7b7-ffd3f9a068d5 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:53.751621 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-d500b686-c4b6-45b9-b453-63a9fa8a5a39 req-c6bc19b6-495d-4388-a7b7-ffd3f9a068d5 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:53.784147 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-d500b686-c4b6-45b9-b453-63a9fa8a5a39 req-c6bc19b6-495d-4388-a7b7-ffd3f9a068d5 service nova] Creating event network-changed:f801c0fd-febc-4835-97ee-811b19175e3e for instance 01f7b0a9-1671-460d-8a52-541dc119c6f6 on hv-cinder-81558 Jun 23 13:42:53.794218 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-d500b686-c4b6-45b9-b453-63a9fa8a5a39 req-c6bc19b6-495d-4388-a7b7-ffd3f9a068d5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065417 Jun 23 13:42:53.801666 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 221/417] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:42:53.955213 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-6a3a6219-83d9-4da7-9edf-19e138c5ab98 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:53.960093 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-6a3a6219-83d9-4da7-9edf-19e138c5ab98 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:53.966755 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6a3a6219-83d9-4da7-9edf-19e138c5ab98 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:53.967725 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6a3a6219-83d9-4da7-9edf-19e138c5ab98 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:53.968708 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6a3a6219-83d9-4da7-9edf-19e138c5ab98 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:53.969211 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6a3a6219-83d9-4da7-9edf-19e138c5ab98 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:54.130217 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-6a3a6219-83d9-4da7-9edf-19e138c5ab98 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:54.142016 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-6a3a6219-83d9-4da7-9edf-19e138c5ab98 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:54.144609 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-6a3a6219-83d9-4da7-9edf-19e138c5ab98 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:54.146448 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-6a3a6219-83d9-4da7-9edf-19e138c5ab98 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1794 microversion: 2.20 time: 0.195937 Jun 23 13:42:54.147735 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 197/418] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:42:53 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1794 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:42:54.618587 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-b515d1a6-2c5e-423c-adcb-1f174ab8b313 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:54.619297 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-b515d1a6-2c5e-423c-adcb-1f174ab8b313 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:54.633298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b515d1a6-2c5e-423c-adcb-1f174ab8b313 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:54.634147 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b515d1a6-2c5e-423c-adcb-1f174ab8b313 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:54.634993 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b515d1a6-2c5e-423c-adcb-1f174ab8b313 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:54.635461 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b515d1a6-2c5e-423c-adcb-1f174ab8b313 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:54.785698 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-b515d1a6-2c5e-423c-adcb-1f174ab8b313 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:54.794312 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-b515d1a6-2c5e-423c-adcb-1f174ab8b313 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1357 microversion: 2.1 time: 0.180893 Jun 23 13:42:54.794890 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 222/419] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:42:54 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:42:54.864954 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-3375b519-7cab-4477-8772-b039348c77b0 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:54.865454 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-3375b519-7cab-4477-8772-b039348c77b0 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: be3d6429-ee63-4240-81e2-764a80f56740] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:54.867891 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:54.873233 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3375b519-7cab-4477-8772-b039348c77b0 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:54.873687 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3375b519-7cab-4477-8772-b039348c77b0 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:54.874466 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3375b519-7cab-4477-8772-b039348c77b0 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:54.874911 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3375b519-7cab-4477-8772-b039348c77b0 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:54.934240 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:55.013302 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.objects.instance [None req-3375b519-7cab-4477-8772-b039348c77b0 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lazy-loading 'services' on Instance uuid be3d6429-ee63-4240-81e2-764a80f56740 {{(pid=134666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:42:55.136797 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-3375b519-7cab-4477-8772-b039348c77b0 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "DELETE /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740/os-volume_attachments/99bc379e-e3b0-4ce7-ac9c-3d054b339f06" status: 202 len: 0 microversion: 2.1 time: 0.275631 Jun 23 13:42:55.137596 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 198/420] 10.222.0.26 () {58 vars in 1415 bytes} [Thu Jun 23 13:42:54 2022] DELETE /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740/os-volume_attachments/99bc379e-e3b0-4ce7-ac9c-3d054b339f06 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 13:42:55.812375 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-84ba8fcd-f5cd-403c-96fc-494c8897696f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:55.813036 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-84ba8fcd-f5cd-403c-96fc-494c8897696f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:55.819885 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-84ba8fcd-f5cd-403c-96fc-494c8897696f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:55.820330 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-84ba8fcd-f5cd-403c-96fc-494c8897696f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:55.821102 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-84ba8fcd-f5cd-403c-96fc-494c8897696f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:55.821535 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-84ba8fcd-f5cd-403c-96fc-494c8897696f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:55.966629 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-84ba8fcd-f5cd-403c-96fc-494c8897696f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:55.974351 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-84ba8fcd-f5cd-403c-96fc-494c8897696f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1357 microversion: 2.1 time: 0.165883 Jun 23 13:42:55.974915 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 223/421] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:42:55 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:42:56.993682 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-94973694-6ad9-458c-bf89-278f9afeec75 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:56.995249 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-94973694-6ad9-458c-bf89-278f9afeec75 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:57.004517 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell0:SELECT=6 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:57.006380 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-94973694-6ad9-458c-bf89-278f9afeec75 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:57.006840 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-94973694-6ad9-458c-bf89-278f9afeec75 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:57.007654 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-94973694-6ad9-458c-bf89-278f9afeec75 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:57.008116 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-94973694-6ad9-458c-bf89-278f9afeec75 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:57.156783 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-94973694-6ad9-458c-bf89-278f9afeec75 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:57.164480 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-94973694-6ad9-458c-bf89-278f9afeec75 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1357 microversion: 2.1 time: 0.175331 Jun 23 13:42:57.165047 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 199/422] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:42:56 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:42:58.185259 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-ff9d59ab-12ae-4944-8345-10a7d4fc5ef9 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:58.186078 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-ff9d59ab-12ae-4944-8345-10a7d4fc5ef9 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:58.190253 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell0:SELECT=2 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:58.191274 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell0:SELECT=10 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:42:58.196070 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ff9d59ab-12ae-4944-8345-10a7d4fc5ef9 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:58.196550 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ff9d59ab-12ae-4944-8345-10a7d4fc5ef9 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:58.197442 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ff9d59ab-12ae-4944-8345-10a7d4fc5ef9 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:58.198117 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ff9d59ab-12ae-4944-8345-10a7d4fc5ef9 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:58.373793 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-ff9d59ab-12ae-4944-8345-10a7d4fc5ef9 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:58.381719 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-ff9d59ab-12ae-4944-8345-10a7d4fc5ef9 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1357 microversion: 2.1 time: 0.202751 Jun 23 13:42:58.382299 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 224/423] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:42:58 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1357 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:42:59.398545 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-bc37abbe-d014-41d1-8b17-8636b8b52508 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:42:59.399982 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-bc37abbe-d014-41d1-8b17-8636b8b52508 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:42:59.406324 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-bc37abbe-d014-41d1-8b17-8636b8b52508 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:59.406775 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-bc37abbe-d014-41d1-8b17-8636b8b52508 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:59.407573 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-bc37abbe-d014-41d1-8b17-8636b8b52508 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:42:59.408037 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-bc37abbe-d014-41d1-8b17-8636b8b52508 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:42:59.545544 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-bc37abbe-d014-41d1-8b17-8636b8b52508 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:42:59.553361 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-bc37abbe-d014-41d1-8b17-8636b8b52508 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1357 microversion: 2.1 time: 0.159055 Jun 23 13:42:59.553933 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 200/424] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:42:59 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:00.570643 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-e8f4ada0-954b-4228-8220-3dd246673ce2 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:00.571239 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-e8f4ada0-954b-4228-8220-3dd246673ce2 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:00.578140 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e8f4ada0-954b-4228-8220-3dd246673ce2 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:00.578593 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e8f4ada0-954b-4228-8220-3dd246673ce2 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:00.579394 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e8f4ada0-954b-4228-8220-3dd246673ce2 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:00.579822 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e8f4ada0-954b-4228-8220-3dd246673ce2 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:00.733226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-e8f4ada0-954b-4228-8220-3dd246673ce2 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:00.741065 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-e8f4ada0-954b-4228-8220-3dd246673ce2 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1357 microversion: 2.1 time: 0.174371 Jun 23 13:43:00.741635 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 225/425] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:00 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:01.758991 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-7282fd4c-29e8-42f8-93ff-92bfaca279cc tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:01.759569 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-7282fd4c-29e8-42f8-93ff-92bfaca279cc tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:01.766300 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7282fd4c-29e8-42f8-93ff-92bfaca279cc tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:01.766740 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7282fd4c-29e8-42f8-93ff-92bfaca279cc tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:01.767569 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7282fd4c-29e8-42f8-93ff-92bfaca279cc tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:01.768016 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7282fd4c-29e8-42f8-93ff-92bfaca279cc tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:01.908481 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-7282fd4c-29e8-42f8-93ff-92bfaca279cc tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:01.916149 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-7282fd4c-29e8-42f8-93ff-92bfaca279cc tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1357 microversion: 2.1 time: 0.161116 Jun 23 13:43:01.916718 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 201/426] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:01 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:02.932635 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-b2000a0b-92fc-49dd-9fde-eba250e512d3 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:02.933365 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-b2000a0b-92fc-49dd-9fde-eba250e512d3 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:02.940009 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b2000a0b-92fc-49dd-9fde-eba250e512d3 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:02.940455 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b2000a0b-92fc-49dd-9fde-eba250e512d3 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:02.941216 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b2000a0b-92fc-49dd-9fde-eba250e512d3 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:02.941653 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b2000a0b-92fc-49dd-9fde-eba250e512d3 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:03.073770 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-b2000a0b-92fc-49dd-9fde-eba250e512d3 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:03.082367 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-b2000a0b-92fc-49dd-9fde-eba250e512d3 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1357 microversion: 2.1 time: 0.153664 Jun 23 13:43:03.083087 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 226/427] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:02 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:03.291315 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-259be5bc-d356-4b2a-b288-f36dc7989588 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1482908411", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1938430720", "security_groups": [{"name": "tempest-secgroup-smoke-6844620"}], "block_device_mapping_v2": [{"uuid": "efb25a77-a191-4d06-a7df-e4d325cfee17", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bb715288-0a54-4ca5-85b6-5a7823648ca0"}]}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:43:03.404614 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.network.neutron [None req-259be5bc-d356-4b2a-b288-f36dc7989588 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] validate_networks() for [('bb715288-0a54-4ca5-85b6-5a7823648ca0', None, None, None, None, None)] {{(pid=134666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 13:43:03.785180 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-259be5bc-d356-4b2a-b288-f36dc7989588 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Flavor limits 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 13:43:03.785604 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-259be5bc-d356-4b2a-b288-f36dc7989588 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Image limits 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 13:43:03.786109 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-259be5bc-d356-4b2a-b288-f36dc7989588 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Flavor pref 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 13:43:03.786514 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-259be5bc-d356-4b2a-b288-f36dc7989588 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Image pref 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 13:43:03.786920 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-259be5bc-d356-4b2a-b288-f36dc7989588 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 13:43:03.797203 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-259be5bc-d356-4b2a-b288-f36dc7989588 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:03.797655 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-259be5bc-d356-4b2a-b288-f36dc7989588 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:03.798601 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-259be5bc-d356-4b2a-b288-f36dc7989588 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:03.799042 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-259be5bc-d356-4b2a-b288-f36dc7989588 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:03.817004 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-259be5bc-d356-4b2a-b288-f36dc7989588 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Getting quotas for project 0d6c438e59834c4084c818053e1fdb93. Resources: {'ram', 'cores', 'instances'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:43:03.821397 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-259be5bc-d356-4b2a-b288-f36dc7989588 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Getting quotas for user 0a9f85caf65f431c96f27a7d04734211 and project 0d6c438e59834c4084c818053e1fdb93. Resources: {'ram', 'cores', 'instances'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:43:03.889200 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-259be5bc-d356-4b2a-b288-f36dc7989588 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Going to run 1 instances... {{(pid=134666) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 13:43:03.891433 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-259be5bc-d356-4b2a-b288-f36dc7989588 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='efb25a77-a191-4d06-a7df-e4d325cfee17',volume_size=None,volume_type=None)] {{(pid=134666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 13:43:04.027740 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-259be5bc-d356-4b2a-b288-f36dc7989588 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.740985 Jun 23 13:43:04.028367 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 202/428] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Jun 23 13:43:03 2022] POST /compute/v2.1/servers => generated 403 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 13:43:04.038703 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-cce7df9b-b893-46ac-a574-d07e03a0ae8c tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:04.039328 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-cce7df9b-b893-46ac-a574-d07e03a0ae8c tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:04.095102 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-cce7df9b-b893-46ac-a574-d07e03a0ae8c tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:04.099939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-e56d2df7-78fc-47ee-9342-efc3ad51735d tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:04.100555 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-e56d2df7-78fc-47ee-9342-efc3ad51735d tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:04.102617 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-cce7df9b-b893-46ac-a574-d07e03a0ae8c tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 200 len: 1095 microversion: 2.1 time: 0.067693 Jun 23 13:43:04.104662 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 227/429] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:04 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:04.113199 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e56d2df7-78fc-47ee-9342-efc3ad51735d tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:04.113659 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e56d2df7-78fc-47ee-9342-efc3ad51735d tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:04.114462 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e56d2df7-78fc-47ee-9342-efc3ad51735d tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:04.114900 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e56d2df7-78fc-47ee-9342-efc3ad51735d tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:04.248295 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-e56d2df7-78fc-47ee-9342-efc3ad51735d tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:04.256568 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-e56d2df7-78fc-47ee-9342-efc3ad51735d tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1357 microversion: 2.1 time: 0.160354 Jun 23 13:43:04.257151 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 203/430] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:04 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:05.120060 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-9c73a642-a3d5-47b0-b335-445263e69a19 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:05.121279 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-9c73a642-a3d5-47b0-b335-445263e69a19 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:05.129030 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9c73a642-a3d5-47b0-b335-445263e69a19 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:05.129480 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9c73a642-a3d5-47b0-b335-445263e69a19 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:05.130247 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9c73a642-a3d5-47b0-b335-445263e69a19 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:05.130676 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9c73a642-a3d5-47b0-b335-445263e69a19 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:05.192274 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-9c73a642-a3d5-47b0-b335-445263e69a19 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:05.201536 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-9c73a642-a3d5-47b0-b335-445263e69a19 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 200 len: 1201 microversion: 2.1 time: 0.085372 Jun 23 13:43:05.202595 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 228/431] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:05 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 1201 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:05.274568 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-6257a7be-fd11-4403-84b9-7da1c5877232 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:05.275191 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-6257a7be-fd11-4403-84b9-7da1c5877232 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:05.284225 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6257a7be-fd11-4403-84b9-7da1c5877232 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:05.284676 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6257a7be-fd11-4403-84b9-7da1c5877232 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:05.285431 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6257a7be-fd11-4403-84b9-7da1c5877232 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:05.286024 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6257a7be-fd11-4403-84b9-7da1c5877232 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:05.426118 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-6257a7be-fd11-4403-84b9-7da1c5877232 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:05.433400 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-6257a7be-fd11-4403-84b9-7da1c5877232 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1357 microversion: 2.1 time: 0.163593 Jun 23 13:43:05.433953 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 204/432] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:05 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:05.821813 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-2bbd15b4-3527-4adb-b7aa-318c10a22419 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:05.822421 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-2bbd15b4-3527-4adb-b7aa-318c10a22419 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: be3d6429-ee63-4240-81e2-764a80f56740] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:05.828656 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2bbd15b4-3527-4adb-b7aa-318c10a22419 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:05.829121 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2bbd15b4-3527-4adb-b7aa-318c10a22419 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:05.829884 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2bbd15b4-3527-4adb-b7aa-318c10a22419 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:05.830314 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2bbd15b4-3527-4adb-b7aa-318c10a22419 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:05.855276 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-2bbd15b4-3527-4adb-b7aa-318c10a22419 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: be3d6429-ee63-4240-81e2-764a80f56740] Going to try to terminate instance {{(pid=134667) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 13:43:05.943891 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-2bbd15b4-3527-4adb-b7aa-318c10a22419 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "DELETE /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740" status: 204 len: 0 microversion: 2.1 time: 0.125600 Jun 23 13:43:05.944392 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 229/433] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Jun 23 13:43:05 2022] DELETE /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 13:43:05.953078 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-8931068d-bac3-4cce-a01e-edad01bf8af5 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:05.953687 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-8931068d-bac3-4cce-a01e-edad01bf8af5 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: be3d6429-ee63-4240-81e2-764a80f56740] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:05.960156 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8931068d-bac3-4cce-a01e-edad01bf8af5 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:05.960611 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8931068d-bac3-4cce-a01e-edad01bf8af5 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:05.961368 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8931068d-bac3-4cce-a01e-edad01bf8af5 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:05.961802 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8931068d-bac3-4cce-a01e-edad01bf8af5 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:06.097548 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-8931068d-bac3-4cce-a01e-edad01bf8af5 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:06.105319 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-8931068d-bac3-4cce-a01e-edad01bf8af5 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740" status: 200 len: 1513 microversion: 2.1 time: 0.156182 Jun 23 13:43:06.105884 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 205/434] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:05 2022] GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:43:06.224486 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-0bd9f5d2-df60-4ba8-bb43-7f3161c226d6 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:06.225577 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-0bd9f5d2-df60-4ba8-bb43-7f3161c226d6 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:06.236362 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0bd9f5d2-df60-4ba8-bb43-7f3161c226d6 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:06.236815 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0bd9f5d2-df60-4ba8-bb43-7f3161c226d6 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:06.237603 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0bd9f5d2-df60-4ba8-bb43-7f3161c226d6 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:06.238044 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0bd9f5d2-df60-4ba8-bb43-7f3161c226d6 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:06.304515 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-0bd9f5d2-df60-4ba8-bb43-7f3161c226d6 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:06.312417 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-0bd9f5d2-df60-4ba8-bb43-7f3161c226d6 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 200 len: 1211 microversion: 2.1 time: 0.095243 Jun 23 13:43:06.312991 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 230/435] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:06 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 1211 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:06.339797 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-80b2484f-4034-4943-9ebc-da8aeb8875e8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:06.340301 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-80b2484f-4034-4943-9ebc-da8aeb8875e8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:06.346810 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-80b2484f-4034-4943-9ebc-da8aeb8875e8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:06.347259 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-80b2484f-4034-4943-9ebc-da8aeb8875e8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:06.348052 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-80b2484f-4034-4943-9ebc-da8aeb8875e8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:06.348497 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-80b2484f-4034-4943-9ebc-da8aeb8875e8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:06.371627 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-80b2484f-4034-4943-9ebc-da8aeb8875e8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d/ips" status: 200 len: 150 microversion: 2.1 time: 0.035665 Jun 23 13:43:06.372147 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 206/436] 10.222.0.26 () {58 vars in 1247 bytes} [Thu Jun 23 13:43:06 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:43:06.383748 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-0c7ed334-6cad-4c8e-8bfa-48a5da99db34 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e61a02d4-713d-4f3d-9861-f9c8b8a956e0"}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:43:06.384944 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-0c7ed334-6cad-4c8e-8bfa-48a5da99db34 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:06.391421 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0c7ed334-6cad-4c8e-8bfa-48a5da99db34 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:06.391982 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0c7ed334-6cad-4c8e-8bfa-48a5da99db34 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:06.392748 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0c7ed334-6cad-4c8e-8bfa-48a5da99db34 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:06.393180 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0c7ed334-6cad-4c8e-8bfa-48a5da99db34 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:06.449915 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-cea79c20-26f1-49b1-8dc4-f0723ef20dcd tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:06.450553 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-cea79c20-26f1-49b1-8dc4-f0723ef20dcd tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:06.456927 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-cea79c20-26f1-49b1-8dc4-f0723ef20dcd tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:06.457354 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-cea79c20-26f1-49b1-8dc4-f0723ef20dcd tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:06.458177 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-cea79c20-26f1-49b1-8dc4-f0723ef20dcd tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:06.459119 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-cea79c20-26f1-49b1-8dc4-f0723ef20dcd tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:06.479600 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.wsgi [None req-0c7ed334-6cad-4c8e-8bfa-48a5da99db34 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] HTTP exception thrown: Invalid volume: volume e61a02d4-713d-4f3d-9861-f9c8b8a956e0 is already attached to instances: f8dd165f-4996-4336-a117-cd2a9ba751fa Jun 23 13:43:06.481288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-0c7ed334-6cad-4c8e-8bfa-48a5da99db34 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Request method failure captured: Jun 23 13:43:06.481288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: POST /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d/os-volume_attachments HTTP/1.1 Jun 23 13:43:06.481288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:43:06.481288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:43:06.481288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:43:06.481288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 74 Jun 23 13:43:06.481288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:43:06.481288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:43:06.481288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:43:06.481288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:43:06.481288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitG0I_HZU131M8J85RvEQOmj8LgA_2WxO2JHaCALyqdLluOOVQseCnN3b49kmuLUwl7kgpYu_nyCOuFs2D4nvXDzPB-BFMJHg1SH6Biig2M0dk2RuXu07iB9rawZfYchoQTmmnBEWqWi0vz9e6Q6R4kGGzJ8cvnvjbn-HCeyXQcr5f7s Jun 23 13:43:06.481288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:43:06.481288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:43:06.481288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:43:06.481288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:43:06.481288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:43:06.481288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:43:06.481288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: 9298bf4635e84993b086309715cc7cbe Jun 23 13:43:06.481288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:43:06.481288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:43:06.481288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:43:06.482803 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9298bf4635e84993b086309715cc7cbe", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:43:06.482803 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:43:06.482803 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: 9298bf4635e84993b086309715cc7cbe Jun 23 13:43:06.482803 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:43:06.482803 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-AttachVolumeNegativeTest-1741631114-project Jun 23 13:43:06.482803 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:43:06.482803 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:43:06.482803 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: 007ce9b8109343e0914efe94c6aa6a89 Jun 23 13:43:06.482803 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-AttachVolumeNegativeTest-1741631114-project Jun 23 13:43:06.482803 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Jun 23 13:43:06.482803 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {"volumeAttachment": {"volumeId": "e61a02d4-713d-4f3d-9861-f9c8b8a956e0"}} Jun 23 13:43:06.482803 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: > Jun 23 13:43:06.483682 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Invalid volume: volume e61a02d4-713d-4f3d-9861-f9c8b8a956e0 is already attached to instances: f8dd165f-4996-4336-a117-cd2a9ba751fa Jun 23 13:43:06.483682 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'server_id': '0417cd02-d58c-4bd7-8847-6b817258fc3d', 'body': {'volumeAttachment': {'volumeId': 'e61a02d4-713d-4f3d-9861-f9c8b8a956e0'}}} Jun 23 13:43:06.483682 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:43:06.483682 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:43:06.483682 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 13:43:06.483682 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 13:43:06.483682 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 13:43:06.483682 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 13:43:06.483682 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 23 13:43:06.483682 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 23 13:43:06.483682 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 23 13:43:06.483682 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 23 13:43:06.483682 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 23 13:43:06.483682 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 23 13:43:06.483682 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e61a02d4-713d-4f3d-9861-f9c8b8a956e0 is already attached to instances: f8dd165f-4996-4336-a117-cd2a9ba751fa Jun 23 13:43:06.483682 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:43:06.483682 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:43:06.483682 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:43:06.483682 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:43:06.484844 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:43:06.484844 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:43:06.484844 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:43:06.484844 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:43:06.484844 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:43:06.484844 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:43:06.484844 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 13:43:06.484844 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 13:43:06.484844 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 13:43:06.484844 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 13:43:06.484844 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 13:43:06.484844 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 13:43:06.484844 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 23 13:43:06.484844 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 23 13:43:06.484844 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e61a02d4-713d-4f3d-9861-f9c8b8a956e0 is already attached to instances: f8dd165f-4996-4336-a117-cd2a9ba751fa Jun 23 13:43:06.484844 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:43:06.484844 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:43:06.484844 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:43:06.484844 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:43:06.484844 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:43:06.486029 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:43:06.486029 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:43:06.486029 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:43:06.486029 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e61a02d4-713d-4f3d-9861-f9c8b8a956e0 is already attached to instances: f8dd165f-4996-4336-a117-cd2a9ba751fa Jun 23 13:43:06.486029 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:43:06.486029 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-0c7ed334-6cad-4c8e-8bfa-48a5da99db34 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Returning 400 to user: Invalid volume: volume e61a02d4-713d-4f3d-9861-f9c8b8a956e0 is already attached to instances: f8dd165f-4996-4336-a117-cd2a9ba751fa {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:43:06.486029 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-0c7ed334-6cad-4c8e-8bfa-48a5da99db34 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "POST /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103021 Jun 23 13:43:06.486029 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 231/437] 10.222.0.26 () {60 vars in 1322 bytes} [Thu Jun 23 13:43:06 2022] POST /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 13:43:06.491412 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-822a6efa-93dc-4f7b-9582-c05bf6de8324 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:06.491905 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-822a6efa-93dc-4f7b-9582-c05bf6de8324 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:06.498674 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-822a6efa-93dc-4f7b-9582-c05bf6de8324 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:06.499087 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-822a6efa-93dc-4f7b-9582-c05bf6de8324 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:06.499902 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-822a6efa-93dc-4f7b-9582-c05bf6de8324 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:06.500335 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-822a6efa-93dc-4f7b-9582-c05bf6de8324 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:06.529755 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-822a6efa-93dc-4f7b-9582-c05bf6de8324 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Going to try to terminate instance {{(pid=134667) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 13:43:06.597690 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-cea79c20-26f1-49b1-8dc4-f0723ef20dcd tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:06.605669 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-cea79c20-26f1-49b1-8dc4-f0723ef20dcd tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1357 microversion: 2.1 time: 0.159532 Jun 23 13:43:06.606273 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 207/438] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:06 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:06.617847 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-822a6efa-93dc-4f7b-9582-c05bf6de8324 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 204 len: 0 microversion: 2.1 time: 0.129673 Jun 23 13:43:06.618464 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 232/439] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Jun 23 13:43:06 2022] DELETE /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 13:43:06.626866 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-e2f63a22-74f7-4d4d-84f8-2e060b2cd411 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:06.627503 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-e2f63a22-74f7-4d4d-84f8-2e060b2cd411 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:06.633457 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e2f63a22-74f7-4d4d-84f8-2e060b2cd411 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:06.634092 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e2f63a22-74f7-4d4d-84f8-2e060b2cd411 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:06.635036 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e2f63a22-74f7-4d4d-84f8-2e060b2cd411 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:06.635661 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e2f63a22-74f7-4d4d-84f8-2e060b2cd411 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:06.763928 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-e2f63a22-74f7-4d4d-84f8-2e060b2cd411 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:06.771261 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-e2f63a22-74f7-4d4d-84f8-2e060b2cd411 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 200 len: 1681 microversion: 2.1 time: 0.148477 Jun 23 13:43:06.771841 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 208/440] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:06 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:07.122969 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-f5bd5a99-4791-4ce6-af45-ba06d98bbbf9 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:07.123996 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-f5bd5a99-4791-4ce6-af45-ba06d98bbbf9 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: be3d6429-ee63-4240-81e2-764a80f56740] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:07.130295 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f5bd5a99-4791-4ce6-af45-ba06d98bbbf9 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:07.130741 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f5bd5a99-4791-4ce6-af45-ba06d98bbbf9 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:07.131531 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f5bd5a99-4791-4ce6-af45-ba06d98bbbf9 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:07.131965 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f5bd5a99-4791-4ce6-af45-ba06d98bbbf9 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:07.266172 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-f5bd5a99-4791-4ce6-af45-ba06d98bbbf9 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:07.276247 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-f5bd5a99-4791-4ce6-af45-ba06d98bbbf9 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740" status: 200 len: 1513 microversion: 2.1 time: 0.157326 Jun 23 13:43:07.276829 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 233/441] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:07 2022] GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:43:07.332417 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-3e506b63-d903-4055-8e36-2702559bf9f4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:07.333127 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-3e506b63-d903-4055-8e36-2702559bf9f4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:07.343068 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3e506b63-d903-4055-8e36-2702559bf9f4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:07.343690 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3e506b63-d903-4055-8e36-2702559bf9f4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:07.344612 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3e506b63-d903-4055-8e36-2702559bf9f4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:07.345155 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3e506b63-d903-4055-8e36-2702559bf9f4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:07.479613 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-3e506b63-d903-4055-8e36-2702559bf9f4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:07.487690 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-3e506b63-d903-4055-8e36-2702559bf9f4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 200 len: 1276 microversion: 2.1 time: 0.161689 Jun 23 13:43:07.488259 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 209/442] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:07 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 1276 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:07.625388 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-87d154a7-9a12-4739-ae49-a37646c768de tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:07.626226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-87d154a7-9a12-4739-ae49-a37646c768de tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:07.636120 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-87d154a7-9a12-4739-ae49-a37646c768de tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:07.636575 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-87d154a7-9a12-4739-ae49-a37646c768de tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:07.637326 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-87d154a7-9a12-4739-ae49-a37646c768de tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:07.637787 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-87d154a7-9a12-4739-ae49-a37646c768de tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:07.776152 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-87d154a7-9a12-4739-ae49-a37646c768de tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:07.788489 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-87d154a7-9a12-4739-ae49-a37646c768de tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1357 microversion: 2.1 time: 0.169125 Jun 23 13:43:07.789328 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 234/443] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:07 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:07.792666 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-42fa7e81-e805-4e58-bffa-7aeb830431d1 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:07.793612 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-42fa7e81-e805-4e58-bffa-7aeb830431d1 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:07.801387 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-42fa7e81-e805-4e58-bffa-7aeb830431d1 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:07.801911 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-42fa7e81-e805-4e58-bffa-7aeb830431d1 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:07.802688 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-42fa7e81-e805-4e58-bffa-7aeb830431d1 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:07.803116 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-42fa7e81-e805-4e58-bffa-7aeb830431d1 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:07.936113 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-42fa7e81-e805-4e58-bffa-7aeb830431d1 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:07.944882 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-42fa7e81-e805-4e58-bffa-7aeb830431d1 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 200 len: 1681 microversion: 2.1 time: 0.158831 Jun 23 13:43:07.945513 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 210/444] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:07 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:08.298099 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-1747fde4-b749-42c0-b5b0-87fcc514ea9a tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:08.299579 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-1747fde4-b749-42c0-b5b0-87fcc514ea9a tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: be3d6429-ee63-4240-81e2-764a80f56740] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:08.307786 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1747fde4-b749-42c0-b5b0-87fcc514ea9a tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:08.308552 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1747fde4-b749-42c0-b5b0-87fcc514ea9a tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:08.309487 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1747fde4-b749-42c0-b5b0-87fcc514ea9a tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:08.310025 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1747fde4-b749-42c0-b5b0-87fcc514ea9a tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:08.313265 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:43:08.443118 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-1747fde4-b749-42c0-b5b0-87fcc514ea9a tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:08.450915 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-1747fde4-b749-42c0-b5b0-87fcc514ea9a tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740" status: 200 len: 1513 microversion: 2.1 time: 0.156885 Jun 23 13:43:08.451863 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 235/445] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:08 2022] GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:08.505179 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-1606433e-ba38-4f29-89bf-ca62b813b14e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:08.505949 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-1606433e-ba38-4f29-89bf-ca62b813b14e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:08.512647 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1606433e-ba38-4f29-89bf-ca62b813b14e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:08.513197 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1606433e-ba38-4f29-89bf-ca62b813b14e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:08.514072 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1606433e-ba38-4f29-89bf-ca62b813b14e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:08.514599 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1606433e-ba38-4f29-89bf-ca62b813b14e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:08.599290 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-67397a4a-6c48-415e-8227-6322e3ac492b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e72ae7a9-bc98-4260-9abb-fd01871f19dc"}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:43:08.600550 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-67397a4a-6c48-415e-8227-6322e3ac492b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:08.637559 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-67397a4a-6c48-415e-8227-6322e3ac492b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:08.639433 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-67397a4a-6c48-415e-8227-6322e3ac492b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:08.642678 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-67397a4a-6c48-415e-8227-6322e3ac492b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:08.643432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-67397a4a-6c48-415e-8227-6322e3ac492b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:08.667477 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-1606433e-ba38-4f29-89bf-ca62b813b14e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:08.676710 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-1606433e-ba38-4f29-89bf-ca62b813b14e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 200 len: 1276 microversion: 2.1 time: 0.175362 Jun 23 13:43:08.678268 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 211/446] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:08 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 1276 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:08.808310 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-d7276740-bce3-4af0-96d7-1b5d61589336 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:08.808935 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-d7276740-bce3-4af0-96d7-1b5d61589336 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:08.830111 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d7276740-bce3-4af0-96d7-1b5d61589336 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:08.830889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d7276740-bce3-4af0-96d7-1b5d61589336 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:08.831903 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d7276740-bce3-4af0-96d7-1b5d61589336 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:08.832673 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d7276740-bce3-4af0-96d7-1b5d61589336 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:08.973013 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-d7276740-bce3-4af0-96d7-1b5d61589336 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:08.980921 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-d7276740-bce3-4af0-96d7-1b5d61589336 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1357 microversion: 2.1 time: 0.176418 Jun 23 13:43:08.981588 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 212/447] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:08 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:08.986086 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-7b56fcd3-5a71-4587-811f-ea5c51da2715 req-e5a293b3-3087-4d1d-aae0-f5cf02cf37cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42c29e33-917a-4263-a80c-9863ed228875", "tag": "e81f7986-69e2-48bc-88f6-03a52eb426dd"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:43:08.994536 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-7b56fcd3-5a71-4587-811f-ea5c51da2715 req-e5a293b3-3087-4d1d-aae0-f5cf02cf37cd service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:08.994974 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-7b56fcd3-5a71-4587-811f-ea5c51da2715 req-e5a293b3-3087-4d1d-aae0-f5cf02cf37cd service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:09.005735 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-7b56fcd3-5a71-4587-811f-ea5c51da2715 req-e5a293b3-3087-4d1d-aae0-f5cf02cf37cd service nova] Creating event network-changed:e81f7986-69e2-48bc-88f6-03a52eb426dd for instance 42c29e33-917a-4263-a80c-9863ed228875 on hv-cinder-81558 Jun 23 13:43:09.010935 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-7b56fcd3-5a71-4587-811f-ea5c51da2715 req-e5a293b3-3087-4d1d-aae0-f5cf02cf37cd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028147 Jun 23 13:43:09.011566 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 213/448] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:43:09.016702 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-a71953c3-b810-405f-b1b0-1a2d5b6d241f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:09.017391 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-a71953c3-b810-405f-b1b0-1a2d5b6d241f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:09.023517 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a71953c3-b810-405f-b1b0-1a2d5b6d241f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:09.024573 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a71953c3-b810-405f-b1b0-1a2d5b6d241f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:09.025384 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a71953c3-b810-405f-b1b0-1a2d5b6d241f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:09.025814 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a71953c3-b810-405f-b1b0-1a2d5b6d241f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:09.165278 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-a71953c3-b810-405f-b1b0-1a2d5b6d241f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:09.173169 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-a71953c3-b810-405f-b1b0-1a2d5b6d241f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 200 len: 1681 microversion: 2.1 time: 0.160170 Jun 23 13:43:09.173740 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 214/449] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:09 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:09.473383 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-197a0a40-c2a9-4c21-b497-1c7fc1535058 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:09.474384 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-197a0a40-c2a9-4c21-b497-1c7fc1535058 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: be3d6429-ee63-4240-81e2-764a80f56740] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:09.484672 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-197a0a40-c2a9-4c21-b497-1c7fc1535058 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:09.485416 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-197a0a40-c2a9-4c21-b497-1c7fc1535058 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:09.486671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-197a0a40-c2a9-4c21-b497-1c7fc1535058 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:09.487402 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-197a0a40-c2a9-4c21-b497-1c7fc1535058 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:09.625636 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-197a0a40-c2a9-4c21-b497-1c7fc1535058 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:09.633409 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-197a0a40-c2a9-4c21-b497-1c7fc1535058 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740" status: 200 len: 1513 microversion: 2.1 time: 0.166799 Jun 23 13:43:09.633973 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 215/450] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:09 2022] GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:09.696453 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-d08d5d7a-808e-4230-8c4e-00157d6ae5c2 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:09.697293 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-d08d5d7a-808e-4230-8c4e-00157d6ae5c2 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:09.705860 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d08d5d7a-808e-4230-8c4e-00157d6ae5c2 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:09.706320 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d08d5d7a-808e-4230-8c4e-00157d6ae5c2 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:09.707412 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d08d5d7a-808e-4230-8c4e-00157d6ae5c2 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:09.708036 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d08d5d7a-808e-4230-8c4e-00157d6ae5c2 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:09.713828 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:43:09.844944 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-d08d5d7a-808e-4230-8c4e-00157d6ae5c2 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:09.853045 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-d08d5d7a-808e-4230-8c4e-00157d6ae5c2 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 200 len: 1276 microversion: 2.1 time: 0.162400 Jun 23 13:43:09.853617 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 216/451] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:09 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 1276 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:09.998473 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-e694c94b-51bd-4cd3-8657-433e2e7ae882 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:09.999086 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-e694c94b-51bd-4cd3-8657-433e2e7ae882 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:10.005991 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e694c94b-51bd-4cd3-8657-433e2e7ae882 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:10.006718 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e694c94b-51bd-4cd3-8657-433e2e7ae882 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:10.007750 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e694c94b-51bd-4cd3-8657-433e2e7ae882 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:10.008345 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e694c94b-51bd-4cd3-8657-433e2e7ae882 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:10.067489 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-67397a4a-6c48-415e-8227-6322e3ac492b tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "POST /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.482583 Jun 23 13:43:10.068504 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 236/452] 10.222.0.26 () {60 vars in 1322 bytes} [Thu Jun 23 13:43:08 2022] POST /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb/os-volume_attachments => generated 194 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:43:10.188563 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-e694c94b-51bd-4cd3-8657-433e2e7ae882 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:10.193924 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-8d91bf90-3f69-4f23-8706-d867de280acb tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:10.194852 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-8d91bf90-3f69-4f23-8706-d867de280acb tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:10.201136 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-e694c94b-51bd-4cd3-8657-433e2e7ae882 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1357 microversion: 2.1 time: 0.206817 Jun 23 13:43:10.201573 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8d91bf90-3f69-4f23-8706-d867de280acb tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:10.201990 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 217/453] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:09 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1357 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:43:10.202451 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8d91bf90-3f69-4f23-8706-d867de280acb tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:10.203784 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8d91bf90-3f69-4f23-8706-d867de280acb tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:10.204431 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8d91bf90-3f69-4f23-8706-d867de280acb tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:10.305212 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-187390d6-193f-415c-a9ed-fdd1a663856d req-1d3591ca-97ec-4a9d-88ab-7cef7009fbe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01f7b0a9-1671-460d-8a52-541dc119c6f6", "name": "network-vif-plugged", "status": "completed", "tag": "f801c0fd-febc-4835-97ee-811b19175e3e"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:43:10.314149 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-187390d6-193f-415c-a9ed-fdd1a663856d req-1d3591ca-97ec-4a9d-88ab-7cef7009fbe1 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:10.315019 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-187390d6-193f-415c-a9ed-fdd1a663856d req-1d3591ca-97ec-4a9d-88ab-7cef7009fbe1 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:10.329607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-187390d6-193f-415c-a9ed-fdd1a663856d req-1d3591ca-97ec-4a9d-88ab-7cef7009fbe1 service nova] Creating event network-vif-plugged:f801c0fd-febc-4835-97ee-811b19175e3e for instance 01f7b0a9-1671-460d-8a52-541dc119c6f6 on hv-cinder-81558 Jun 23 13:43:10.335884 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-187390d6-193f-415c-a9ed-fdd1a663856d req-1d3591ca-97ec-4a9d-88ab-7cef7009fbe1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034147 Jun 23 13:43:10.337058 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 218/454] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 13:43:10.368757 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-8d91bf90-3f69-4f23-8706-d867de280acb tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:10.376527 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-8d91bf90-3f69-4f23-8706-d867de280acb tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 200 len: 1681 microversion: 2.1 time: 0.189974 Jun 23 13:43:10.377374 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 237/455] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:10 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:10.650562 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-204cda54-b0b7-4f4c-97be-b2bb39462711 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:10.651292 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-204cda54-b0b7-4f4c-97be-b2bb39462711 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: be3d6429-ee63-4240-81e2-764a80f56740] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:10.658170 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-204cda54-b0b7-4f4c-97be-b2bb39462711 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:10.658614 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-204cda54-b0b7-4f4c-97be-b2bb39462711 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:10.659758 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-204cda54-b0b7-4f4c-97be-b2bb39462711 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:10.659887 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-204cda54-b0b7-4f4c-97be-b2bb39462711 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:10.793417 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-204cda54-b0b7-4f4c-97be-b2bb39462711 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:10.802570 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-204cda54-b0b7-4f4c-97be-b2bb39462711 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740" status: 200 len: 1513 microversion: 2.1 time: 0.156127 Jun 23 13:43:10.806828 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 219/456] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:10 2022] GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:10.870204 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-8a1f715c-6eb9-4001-9beb-d7b95da93c56 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:10.870979 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-8a1f715c-6eb9-4001-9beb-d7b95da93c56 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:10.878130 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8a1f715c-6eb9-4001-9beb-d7b95da93c56 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:10.878579 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8a1f715c-6eb9-4001-9beb-d7b95da93c56 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:10.879367 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8a1f715c-6eb9-4001-9beb-d7b95da93c56 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:10.879790 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8a1f715c-6eb9-4001-9beb-d7b95da93c56 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:11.013843 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-8a1f715c-6eb9-4001-9beb-d7b95da93c56 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:11.022165 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-8a1f715c-6eb9-4001-9beb-d7b95da93c56 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 200 len: 1264 microversion: 2.1 time: 0.155191 Jun 23 13:43:11.022165 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 238/457] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:10 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:11.219676 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-2f434bdc-353b-474e-8711-737d9b225949 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:11.220598 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-2f434bdc-353b-474e-8711-737d9b225949 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:11.227321 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2f434bdc-353b-474e-8711-737d9b225949 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:11.227889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2f434bdc-353b-474e-8711-737d9b225949 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:11.228735 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2f434bdc-353b-474e-8711-737d9b225949 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:11.229346 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2f434bdc-353b-474e-8711-737d9b225949 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:11.364396 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-2f434bdc-353b-474e-8711-737d9b225949 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:11.375363 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-2f434bdc-353b-474e-8711-737d9b225949 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1357 microversion: 2.1 time: 0.160403 Jun 23 13:43:11.376025 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 220/458] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:11 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:11.394018 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-cfe0743c-627d-4038-8971-f34028481d9f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:11.394627 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-cfe0743c-627d-4038-8971-f34028481d9f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:11.401542 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-cfe0743c-627d-4038-8971-f34028481d9f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:11.401983 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-cfe0743c-627d-4038-8971-f34028481d9f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:11.402782 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-cfe0743c-627d-4038-8971-f34028481d9f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:11.403376 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-cfe0743c-627d-4038-8971-f34028481d9f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:11.444537 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-1bdba074-9ffa-40cc-871d-994a93380ae3 req-ea5c6dee-b61b-43cd-a426-3689641a4bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be3d6429-ee63-4240-81e2-764a80f56740", "name": "network-vif-deleted", "tag": "b7c518e1-beb1-491b-99ec-6f9a8f70d5f6"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:43:11.455550 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-1bdba074-9ffa-40cc-871d-994a93380ae3 req-ea5c6dee-b61b-43cd-a426-3689641a4bf0 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:11.456069 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-1bdba074-9ffa-40cc-871d-994a93380ae3 req-ea5c6dee-b61b-43cd-a426-3689641a4bf0 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:11.472812 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-1bdba074-9ffa-40cc-871d-994a93380ae3 req-ea5c6dee-b61b-43cd-a426-3689641a4bf0 service nova] Creating event network-vif-deleted:b7c518e1-beb1-491b-99ec-6f9a8f70d5f6 for instance be3d6429-ee63-4240-81e2-764a80f56740 on hv-cinder-81558 Jun 23 13:43:11.478430 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-1bdba074-9ffa-40cc-871d-994a93380ae3 req-ea5c6dee-b61b-43cd-a426-3689641a4bf0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039804 Jun 23 13:43:11.479386 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 221/459] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:43:11.540693 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-cfe0743c-627d-4038-8971-f34028481d9f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:11.548244 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-cfe0743c-627d-4038-8971-f34028481d9f tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 200 len: 1681 microversion: 2.1 time: 0.158110 Jun 23 13:43:11.548860 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 239/460] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:11 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:11.820445 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-867ff3b2-5751-4d50-a33a-118205137dae tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:11.821283 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-867ff3b2-5751-4d50-a33a-118205137dae tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: be3d6429-ee63-4240-81e2-764a80f56740] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:11.828582 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-867ff3b2-5751-4d50-a33a-118205137dae tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:11.829020 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-867ff3b2-5751-4d50-a33a-118205137dae tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:11.829782 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-867ff3b2-5751-4d50-a33a-118205137dae tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:11.830230 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-867ff3b2-5751-4d50-a33a-118205137dae tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:11.865494 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-867ff3b2-5751-4d50-a33a-118205137dae tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:11.865884 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-867ff3b2-5751-4d50-a33a-118205137dae tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:11.866320 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.objects.instance [None req-867ff3b2-5751-4d50-a33a-118205137dae tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lazy-loading 'fault' on Instance uuid be3d6429-ee63-4240-81e2-764a80f56740 {{(pid=134666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:43:11.918365 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-867ff3b2-5751-4d50-a33a-118205137dae tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:11.926931 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-867ff3b2-5751-4d50-a33a-118205137dae tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740" status: 200 len: 1309 microversion: 2.1 time: 0.110857 Jun 23 13:43:11.927623 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 222/461] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:11 2022] GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740 => generated 1309 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:12.040011 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-865ab1d2-9d6b-48ca-b8da-bbf434052e9a tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:12.041402 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-865ab1d2-9d6b-48ca-b8da-bbf434052e9a tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:12.047698 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-865ab1d2-9d6b-48ca-b8da-bbf434052e9a tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:12.048265 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-865ab1d2-9d6b-48ca-b8da-bbf434052e9a tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:12.049054 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-865ab1d2-9d6b-48ca-b8da-bbf434052e9a tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:12.049481 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-865ab1d2-9d6b-48ca-b8da-bbf434052e9a tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:12.245913 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-865ab1d2-9d6b-48ca-b8da-bbf434052e9a tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:12.254574 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-865ab1d2-9d6b-48ca-b8da-bbf434052e9a tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 200 len: 1264 microversion: 2.1 time: 0.220216 Jun 23 13:43:12.255371 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 240/462] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:12 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 1264 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:12.393130 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-63423799-7f1d-41af-a0ba-f2509400bad2 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:12.393756 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-63423799-7f1d-41af-a0ba-f2509400bad2 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:12.400677 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-63423799-7f1d-41af-a0ba-f2509400bad2 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:12.401132 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-63423799-7f1d-41af-a0ba-f2509400bad2 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:12.401916 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-63423799-7f1d-41af-a0ba-f2509400bad2 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:12.402353 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-63423799-7f1d-41af-a0ba-f2509400bad2 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:12.545577 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-63423799-7f1d-41af-a0ba-f2509400bad2 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:12.553702 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-63423799-7f1d-41af-a0ba-f2509400bad2 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1546 microversion: 2.1 time: 0.164609 Jun 23 13:43:12.554504 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 223/463] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:12 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1546 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:12.565809 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-d3f1a729-fcf2-4cef-90b2-3127e8e8b876 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:12.567223 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-d3f1a729-fcf2-4cef-90b2-3127e8e8b876 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:12.572552 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-48900372-6373-4401-afb1-36809bffab0b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:12.579302 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d3f1a729-fcf2-4cef-90b2-3127e8e8b876 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:12.580258 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-48900372-6373-4401-afb1-36809bffab0b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:12.583867 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d3f1a729-fcf2-4cef-90b2-3127e8e8b876 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:12.584649 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d3f1a729-fcf2-4cef-90b2-3127e8e8b876 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:12.585229 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d3f1a729-fcf2-4cef-90b2-3127e8e8b876 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:12.587662 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-48900372-6373-4401-afb1-36809bffab0b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:12.588898 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-48900372-6373-4401-afb1-36809bffab0b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:12.589698 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-48900372-6373-4401-afb1-36809bffab0b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:12.590112 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-48900372-6373-4401-afb1-36809bffab0b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:12.888967 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-d3f1a729-fcf2-4cef-90b2-3127e8e8b876 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:12.900581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-d3f1a729-fcf2-4cef-90b2-3127e8e8b876 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 200 len: 1326 microversion: 2.1 time: 0.339538 Jun 23 13:43:12.903439 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 241/464] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:12 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 1326 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:43:12.943648 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-16687026-d03f-400e-b717-84f0fee68416 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:12.944424 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-16687026-d03f-400e-b717-84f0fee68416 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: be3d6429-ee63-4240-81e2-764a80f56740] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:12.952343 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-16687026-d03f-400e-b717-84f0fee68416 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:12.953261 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-16687026-d03f-400e-b717-84f0fee68416 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:12.954332 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-16687026-d03f-400e-b717-84f0fee68416 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:12.954975 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-16687026-d03f-400e-b717-84f0fee68416 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:12.972119 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.wsgi [None req-16687026-d03f-400e-b717-84f0fee68416 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] HTTP exception thrown: Instance be3d6429-ee63-4240-81e2-764a80f56740 could not be found. Jun 23 13:43:12.974015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-16687026-d03f-400e-b717-84f0fee68416 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Request method failure captured: Jun 23 13:43:12.974015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740 HTTP/1.1 Jun 23 13:43:12.974015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:43:12.974015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:43:12.974015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:43:12.974015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 0 Jun 23 13:43:12.974015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:43:12.974015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:43:12.974015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:43:12.974015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:43:12.974015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitG16TJmP_rpOoAzFJB8B07sO1fB6YsjME2jnHOI6NkuAQt9oHn8VeRwvM6BEAnK3w8-SsKukrofLE1CYSJs2DN0bybigREVN3dt2lZQN6xKF0BGyiIH7oz-nonTarQrHJfHJcgiY295aTkHJtONeJV2Az5h3cTzdbbxmqypFuIfuz_4 Jun 23 13:43:12.974015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:43:12.974015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:43:12.974015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:43:12.974015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:43:12.974015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:43:12.974015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:43:12.974015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: 5ed01b7f521c413e944560db54281ebc Jun 23 13:43:12.974015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-VolumesSnapshotTestJSON-209705941 Jun 23 13:43:12.974015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:43:12.974015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:43:12.975566 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5ed01b7f521c413e944560db54281ebc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5ed01b7f521c413e944560db54281ebc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5ed01b7f521c413e944560db54281ebc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5ed01b7f521c413e944560db54281ebc", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:43:12.975566 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-VolumesSnapshotTestJSON-209705941 Jun 23 13:43:12.975566 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: 5ed01b7f521c413e944560db54281ebc Jun 23 13:43:12.975566 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-209705941 Jun 23 13:43:12.975566 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-VolumesSnapshotTestJSON-209705941-project Jun 23 13:43:12.975566 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:43:12.975566 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:43:12.975566 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: 7fd8fce7c040433e908a4fe6c6b13e08 Jun 23 13:43:12.975566 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-VolumesSnapshotTestJSON-209705941-project Jun 23 13:43:12.975566 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: > Jun 23 13:43:12.975566 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Instance be3d6429-ee63-4240-81e2-764a80f56740 could not be found. Jun 23 13:43:12.975566 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'id': 'be3d6429-ee63-4240-81e2-764a80f56740'} Jun 23 13:43:12.976432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:43:12.976432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:43:12.976432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:43:12.976432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:43:12.976432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:43:12.976432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:43:12.976432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:43:12.976432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:43:12.976432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:43:12.976432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:43:12.976432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be3d6429-ee63-4240-81e2-764a80f56740 could not be found. Jun 23 13:43:12.976432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:43:12.976432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:43:12.976432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:43:12.976432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:43:12.976432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:43:12.976432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:43:12.976432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:43:12.976432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:43:12.976432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:43:12.977581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:43:12.977581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:43:12.977581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:43:12.977581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:43:12.977581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:43:12.977581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:43:12.977581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:43:12.977581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be3d6429-ee63-4240-81e2-764a80f56740 could not be found. Jun 23 13:43:12.977581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:43:12.977581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:43:12.977581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:43:12.977581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:43:12.977581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:43:12.977581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:43:12.977581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:43:12.977581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:43:12.977581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be3d6429-ee63-4240-81e2-764a80f56740 could not be found. Jun 23 13:43:12.977581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:43:12.978701 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-16687026-d03f-400e-b717-84f0fee68416 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Returning 404 to user: Instance be3d6429-ee63-4240-81e2-764a80f56740 could not be found. {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:43:12.978701 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-16687026-d03f-400e-b717-84f0fee68416 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740" status: 404 len: 111 microversion: 2.1 time: 0.035999 Jun 23 13:43:12.978701 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 242/465] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:12 2022] GET /compute/v2.1/servers/be3d6429-ee63-4240-81e2-764a80f56740 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 13:43:12.985861 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-48900372-6373-4401-afb1-36809bffab0b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:12.996330 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-48900372-6373-4401-afb1-36809bffab0b tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1546 microversion: 2.1 time: 0.427212 Jun 23 13:43:12.996639 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 224/466] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:12 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1546 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:13.011632 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-407570c3-3cfd-4282-a785-6a43f2c4e083 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:13.015077 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-407570c3-3cfd-4282-a785-6a43f2c4e083 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:13.015872 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-407570c3-3cfd-4282-a785-6a43f2c4e083 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Searching by: {'deleted': False, 'project_id': '28b455b8dd8b4910803ac509413a97e6'} {{(pid=134667) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 23 13:43:13.023222 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-407570c3-3cfd-4282-a785-6a43f2c4e083 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:13.023699 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-407570c3-3cfd-4282-a785-6a43f2c4e083 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:13.024478 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-407570c3-3cfd-4282-a785-6a43f2c4e083 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:13.024902 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-407570c3-3cfd-4282-a785-6a43f2c4e083 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:13.123599 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.multi_cell_list [None req-407570c3-3cfd-4282-a785-6a43f2c4e083 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=134667) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 23 13:43:13.238124 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-407570c3-3cfd-4282-a785-6a43f2c4e083 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.229847 Jun 23 13:43:13.243589 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 243/467] 10.222.0.26 () {58 vars in 1124 bytes} [Thu Jun 23 13:43:13 2022] GET /compute/v2.1/servers => generated 342 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:43:13.249194 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-1b7dd723-ed45-45ef-8c2f-74ad2e225623 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:13.251993 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-1b7dd723-ed45-45ef-8c2f-74ad2e225623 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:13.260151 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1b7dd723-ed45-45ef-8c2f-74ad2e225623 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:13.264585 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1b7dd723-ed45-45ef-8c2f-74ad2e225623 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:13.267250 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1b7dd723-ed45-45ef-8c2f-74ad2e225623 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:13.272304 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-9698815b-4525-45cd-b8f6-89457c781e59 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:13.273572 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-9698815b-4525-45cd-b8f6-89457c781e59 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:13.277454 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1b7dd723-ed45-45ef-8c2f-74ad2e225623 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:13.284121 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9698815b-4525-45cd-b8f6-89457c781e59 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:13.286536 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9698815b-4525-45cd-b8f6-89457c781e59 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:13.287537 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9698815b-4525-45cd-b8f6-89457c781e59 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:13.288133 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9698815b-4525-45cd-b8f6-89457c781e59 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:13.511105 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-1b7dd723-ed45-45ef-8c2f-74ad2e225623 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:13.514147 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-9698815b-4525-45cd-b8f6-89457c781e59 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:13.519461 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-1b7dd723-ed45-45ef-8c2f-74ad2e225623 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1546 microversion: 2.1 time: 0.274478 Jun 23 13:43:13.520323 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 225/468] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:13 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1546 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:13.521987 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-9698815b-4525-45cd-b8f6-89457c781e59 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 200 len: 1264 microversion: 2.1 time: 0.254254 Jun 23 13:43:13.531140 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 244/469] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:13 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 1264 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:43:13.531285 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-f1f4d54c-4fdc-449b-afea-a7bc171ef00b req-588cb4a7-7046-4f54-ba41-39f2dc9ab33f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0417cd02-d58c-4bd7-8847-6b817258fc3d", "name": "network-vif-deleted", "tag": "8ea31764-a046-4254-ae49-a5854ff7c61e"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:43:13.535551 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-f1f4d54c-4fdc-449b-afea-a7bc171ef00b req-588cb4a7-7046-4f54-ba41-39f2dc9ab33f service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:13.536013 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-f1f4d54c-4fdc-449b-afea-a7bc171ef00b req-588cb4a7-7046-4f54-ba41-39f2dc9ab33f service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:13.547176 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-f1f4d54c-4fdc-449b-afea-a7bc171ef00b req-588cb4a7-7046-4f54-ba41-39f2dc9ab33f service nova] Creating event network-vif-deleted:8ea31764-a046-4254-ae49-a5854ff7c61e for instance 0417cd02-d58c-4bd7-8847-6b817258fc3d on hv-cinder-81558 Jun 23 13:43:13.552093 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-f1f4d54c-4fdc-449b-afea-a7bc171ef00b req-588cb4a7-7046-4f54-ba41-39f2dc9ab33f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030722 Jun 23 13:43:13.552681 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 226/470] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:43:13.920968 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-ea4a7e13-4be1-4c01-b44f-939095100694 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:13.921602 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-ea4a7e13-4be1-4c01-b44f-939095100694 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:13.928767 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ea4a7e13-4be1-4c01-b44f-939095100694 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:13.929219 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ea4a7e13-4be1-4c01-b44f-939095100694 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:13.929994 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ea4a7e13-4be1-4c01-b44f-939095100694 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:13.930426 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ea4a7e13-4be1-4c01-b44f-939095100694 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:13.945077 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.wsgi [None req-ea4a7e13-4be1-4c01-b44f-939095100694 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] HTTP exception thrown: Instance 0417cd02-d58c-4bd7-8847-6b817258fc3d could not be found. Jun 23 13:43:13.946418 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-ea4a7e13-4be1-4c01-b44f-939095100694 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Request method failure captured: Jun 23 13:43:13.946418 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d HTTP/1.1 Jun 23 13:43:13.946418 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:43:13.946418 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:43:13.946418 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:43:13.946418 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 0 Jun 23 13:43:13.946418 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:43:13.946418 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:43:13.946418 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:43:13.946418 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:43:13.946418 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitG0I_HZU131M8J85RvEQOmj8LgA_2WxO2JHaCALyqdLluOOVQseCnN3b49kmuLUwl7kgpYu_nyCOuFs2D4nvXDzPB-BFMJHg1SH6Biig2M0dk2RuXu07iB9rawZfYchoQTmmnBEWqWi0vz9e6Q6R4kGGzJ8cvnvjbn-HCeyXQcr5f7s Jun 23 13:43:13.946418 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:43:13.946418 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:43:13.946418 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:43:13.946418 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:43:13.946418 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:43:13.946418 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:43:13.946418 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: 9298bf4635e84993b086309715cc7cbe Jun 23 13:43:13.946418 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:43:13.946418 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:43:13.946418 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:43:13.947956 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9298bf4635e84993b086309715cc7cbe", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:43:13.947956 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:43:13.947956 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: 9298bf4635e84993b086309715cc7cbe Jun 23 13:43:13.947956 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:43:13.947956 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-AttachVolumeNegativeTest-1741631114-project Jun 23 13:43:13.947956 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:43:13.947956 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:43:13.947956 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: 007ce9b8109343e0914efe94c6aa6a89 Jun 23 13:43:13.947956 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-AttachVolumeNegativeTest-1741631114-project Jun 23 13:43:13.947956 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: > Jun 23 13:43:13.947956 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Instance 0417cd02-d58c-4bd7-8847-6b817258fc3d could not be found. Jun 23 13:43:13.947956 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'id': '0417cd02-d58c-4bd7-8847-6b817258fc3d'} Jun 23 13:43:13.948715 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:43:13.948715 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:43:13.948715 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:43:13.948715 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:43:13.948715 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:43:13.948715 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:43:13.948715 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:43:13.948715 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:43:13.948715 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:43:13.948715 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:43:13.948715 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0417cd02-d58c-4bd7-8847-6b817258fc3d could not be found. Jun 23 13:43:13.948715 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:43:13.948715 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:43:13.948715 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:43:13.948715 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:43:13.948715 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:43:13.948715 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:43:13.948715 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:43:13.948715 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:43:13.948715 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:43:13.949829 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:43:13.949829 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:43:13.949829 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:43:13.949829 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:43:13.949829 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:43:13.949829 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:43:13.949829 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:43:13.949829 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0417cd02-d58c-4bd7-8847-6b817258fc3d could not be found. Jun 23 13:43:13.949829 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:43:13.949829 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:43:13.949829 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:43:13.949829 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:43:13.949829 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:43:13.949829 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:43:13.949829 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:43:13.949829 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:43:13.949829 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0417cd02-d58c-4bd7-8847-6b817258fc3d could not be found. Jun 23 13:43:13.949829 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:43:13.950841 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-ea4a7e13-4be1-4c01-b44f-939095100694 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Returning 404 to user: Instance 0417cd02-d58c-4bd7-8847-6b817258fc3d could not be found. {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:43:13.950841 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-ea4a7e13-4be1-4c01-b44f-939095100694 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 404 len: 111 microversion: 2.1 time: 0.031769 Jun 23 13:43:13.952054 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 245/471] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:13 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:43:13.955023 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell0:SELECT=2 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:43:13.956350 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell0:SELECT=6 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:43:13.961086 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-24bf0389-e8c8-4887-a025-11876f045a14 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '.version_select at 0x7fd772511d30>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:13.982505 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-24bf0389-e8c8-4887-a025-11876f045a14 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-777721427" status: 202 len: 0 microversion: 2.1 time: 0.028656 Jun 23 13:43:13.983190 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 227/472] 10.222.0.26 () {58 vars in 1217 bytes} [Thu Jun 23 13:43:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-777721427 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 13:43:14.538145 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-8cda78ed-3bc6-4439-a70c-44cda98dcfdb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:14.538766 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-8cda78ed-3bc6-4439-a70c-44cda98dcfdb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:14.540796 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell0:SELECT=2 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:43:14.546399 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8cda78ed-3bc6-4439-a70c-44cda98dcfdb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:14.546871 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8cda78ed-3bc6-4439-a70c-44cda98dcfdb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:14.547671 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8cda78ed-3bc6-4439-a70c-44cda98dcfdb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:14.548150 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8cda78ed-3bc6-4439-a70c-44cda98dcfdb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:14.693634 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-8cda78ed-3bc6-4439-a70c-44cda98dcfdb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:14.693776 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-7472a86a-c3df-4df3-8268-00a96bde6795 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:14.694252 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-7472a86a-c3df-4df3-8268-00a96bde6795 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:14.700930 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7472a86a-c3df-4df3-8268-00a96bde6795 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:14.701391 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7472a86a-c3df-4df3-8268-00a96bde6795 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:14.702101 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-8cda78ed-3bc6-4439-a70c-44cda98dcfdb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 200 len: 1264 microversion: 2.1 time: 0.167856 Jun 23 13:43:14.702214 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7472a86a-c3df-4df3-8268-00a96bde6795 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:14.702630 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7472a86a-c3df-4df3-8268-00a96bde6795 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:14.703179 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 246/473] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:14 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:14.793239 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.objects.instance [None req-7472a86a-c3df-4df3-8268-00a96bde6795 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lazy-loading 'services' on Instance uuid f8dd165f-4996-4336-a117-cd2a9ba751fa {{(pid=134666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:43:14.866820 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-7472a86a-c3df-4df3-8268-00a96bde6795 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa/os-volume_attachments/e61a02d4-713d-4f3d-9861-f9c8b8a956e0" status: 202 len: 0 microversion: 2.1 time: 0.177111 Jun 23 13:43:14.867644 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 228/474] 10.222.0.26 () {58 vars in 1415 bytes} [Thu Jun 23 13:43:14 2022] DELETE /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa/os-volume_attachments/e61a02d4-713d-4f3d-9861-f9c8b8a956e0 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 13:43:14.876605 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-bad1e93f-8487-437b-bf95-cb7c0dc51588 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:14.877740 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-bad1e93f-8487-437b-bf95-cb7c0dc51588 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:14.884139 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bad1e93f-8487-437b-bf95-cb7c0dc51588 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:14.884615 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bad1e93f-8487-437b-bf95-cb7c0dc51588 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:14.885372 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bad1e93f-8487-437b-bf95-cb7c0dc51588 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:14.885768 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bad1e93f-8487-437b-bf95-cb7c0dc51588 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:14.914639 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-bad1e93f-8487-437b-bf95-cb7c0dc51588 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042586 Jun 23 13:43:14.915239 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 247/475] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Jun 23 13:43:14 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:43:15.719479 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-4a1d36a5-fc14-482d-9116-20b404bf8b45 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:15.720237 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-4a1d36a5-fc14-482d-9116-20b404bf8b45 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:15.727218 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4a1d36a5-fc14-482d-9116-20b404bf8b45 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:15.727736 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4a1d36a5-fc14-482d-9116-20b404bf8b45 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:15.728497 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4a1d36a5-fc14-482d-9116-20b404bf8b45 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:15.728937 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4a1d36a5-fc14-482d-9116-20b404bf8b45 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:15.858314 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-4a1d36a5-fc14-482d-9116-20b404bf8b45 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:15.866035 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-4a1d36a5-fc14-482d-9116-20b404bf8b45 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 200 len: 1264 microversion: 2.1 time: 0.150913 Jun 23 13:43:15.866602 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 229/476] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:15 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:15.926314 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-5828ff7e-36c5-408c-a4fb-da5efb817b65 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:15.927238 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-5828ff7e-36c5-408c-a4fb-da5efb817b65 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:15.929649 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:43:15.935633 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5828ff7e-36c5-408c-a4fb-da5efb817b65 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:15.936082 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5828ff7e-36c5-408c-a4fb-da5efb817b65 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:15.936848 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5828ff7e-36c5-408c-a4fb-da5efb817b65 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:15.937288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5828ff7e-36c5-408c-a4fb-da5efb817b65 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:15.968482 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-5828ff7e-36c5-408c-a4fb-da5efb817b65 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046153 Jun 23 13:43:15.969025 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 248/477] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Jun 23 13:43:15 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:43:16.886876 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-f144b45e-ed1c-4503-95e7-70984cfd73b2 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:16.887750 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-f144b45e-ed1c-4503-95e7-70984cfd73b2 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:16.896496 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f144b45e-ed1c-4503-95e7-70984cfd73b2 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:16.896937 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f144b45e-ed1c-4503-95e7-70984cfd73b2 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:16.897692 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f144b45e-ed1c-4503-95e7-70984cfd73b2 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:16.898118 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f144b45e-ed1c-4503-95e7-70984cfd73b2 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:16.990190 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-8d746887-42c1-45ee-9ba5-d875821f2f96 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:16.991630 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-8d746887-42c1-45ee-9ba5-d875821f2f96 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:17.000046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8d746887-42c1-45ee-9ba5-d875821f2f96 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:17.009090 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8d746887-42c1-45ee-9ba5-d875821f2f96 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:17.010341 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8d746887-42c1-45ee-9ba5-d875821f2f96 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:17.010800 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8d746887-42c1-45ee-9ba5-d875821f2f96 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:17.046089 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-f144b45e-ed1c-4503-95e7-70984cfd73b2 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:17.049108 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-8d746887-42c1-45ee-9ba5-d875821f2f96 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062947 Jun 23 13:43:17.050679 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 249/478] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Jun 23 13:43:16 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:43:17.054049 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-f144b45e-ed1c-4503-95e7-70984cfd73b2 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 200 len: 1264 microversion: 2.1 time: 0.173647 Jun 23 13:43:17.054614 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 230/479] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:16 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:17.162452 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-3a4d6f50-b18a-4b32-9fc4-1bc1a6a7d4c4 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2aba6908-ec73-4663-837e-033a1d100183"}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:43:17.163617 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-3a4d6f50-b18a-4b32-9fc4-1bc1a6a7d4c4 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:17.169871 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3a4d6f50-b18a-4b32-9fc4-1bc1a6a7d4c4 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:17.170315 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3a4d6f50-b18a-4b32-9fc4-1bc1a6a7d4c4 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:17.171068 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3a4d6f50-b18a-4b32-9fc4-1bc1a6a7d4c4 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:17.171509 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3a4d6f50-b18a-4b32-9fc4-1bc1a6a7d4c4 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:17.493841 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:43:17.624695 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-3a4d6f50-b18a-4b32-9fc4-1bc1a6a7d4c4 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "POST /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.466582 Jun 23 13:43:17.625606 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 250/480] 10.222.0.26 () {60 vars in 1322 bytes} [Thu Jun 23 13:43:17 2022] POST /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6/os-volume_attachments => generated 194 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:43:17.672541 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-b79a3784-edd7-4286-9995-699f85a5d1cb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:43:17.673875 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-b79a3784-edd7-4286-9995-699f85a5d1cb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:17.681746 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b79a3784-edd7-4286-9995-699f85a5d1cb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:17.682378 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b79a3784-edd7-4286-9995-699f85a5d1cb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:17.682980 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b79a3784-edd7-4286-9995-699f85a5d1cb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:17.683427 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b79a3784-edd7-4286-9995-699f85a5d1cb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:17.709029 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.objects.instance [None req-b79a3784-edd7-4286-9995-699f85a5d1cb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lazy-loading 'flavor' on Instance uuid d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb {{(pid=134666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:43:17.866659 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-b79a3784-edd7-4286-9995-699f85a5d1cb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "POST /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb/action" status: 200 len: 32 microversion: 2.1 time: 0.199235 Jun 23 13:43:17.867355 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 231/481] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Jun 23 13:43:17 2022] POST /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb/action => generated 32 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 13:43:17.877333 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-fbe62a65-815a-4574-8b64-1f71bbe6e76e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:17.878027 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-fbe62a65-815a-4574-8b64-1f71bbe6e76e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:17.884749 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fbe62a65-815a-4574-8b64-1f71bbe6e76e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:17.885289 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fbe62a65-815a-4574-8b64-1f71bbe6e76e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:17.886281 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fbe62a65-815a-4574-8b64-1f71bbe6e76e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:17.887019 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fbe62a65-815a-4574-8b64-1f71bbe6e76e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:18.037660 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-fbe62a65-815a-4574-8b64-1f71bbe6e76e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:18.046585 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-fbe62a65-815a-4574-8b64-1f71bbe6e76e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1735 microversion: 2.1 time: 0.173638 Jun 23 13:43:18.047122 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 251/482] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:17 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:18.063379 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c40ea2a0-53ef-4964-94c6-495e2428b7a7 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:18.064478 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-c40ea2a0-53ef-4964-94c6-495e2428b7a7 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:18.070063 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-07770855-ab32-410b-a556-d8b8c8077534 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:18.070847 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-07770855-ab32-410b-a556-d8b8c8077534 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:18.071848 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c40ea2a0-53ef-4964-94c6-495e2428b7a7 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:18.072303 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c40ea2a0-53ef-4964-94c6-495e2428b7a7 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:18.073061 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c40ea2a0-53ef-4964-94c6-495e2428b7a7 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:18.073486 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c40ea2a0-53ef-4964-94c6-495e2428b7a7 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:18.077075 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-07770855-ab32-410b-a556-d8b8c8077534 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:18.077517 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-07770855-ab32-410b-a556-d8b8c8077534 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:18.078262 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-07770855-ab32-410b-a556-d8b8c8077534 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:18.078692 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-07770855-ab32-410b-a556-d8b8c8077534 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:18.102499 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:43:18.106786 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-c40ea2a0-53ef-4964-94c6-495e2428b7a7 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049182 Jun 23 13:43:18.111470 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 232/483] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Jun 23 13:43:18 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 23 13:43:18.166086 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-e743e4b9-5ce8-4c82-8fe2-94a7f48a4d8d tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:18.166575 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-e743e4b9-5ce8-4c82-8fe2-94a7f48a4d8d tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:18.173332 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e743e4b9-5ce8-4c82-8fe2-94a7f48a4d8d tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:18.173774 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e743e4b9-5ce8-4c82-8fe2-94a7f48a4d8d tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:18.174524 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e743e4b9-5ce8-4c82-8fe2-94a7f48a4d8d tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:18.174950 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e743e4b9-5ce8-4c82-8fe2-94a7f48a4d8d tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:18.199941 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-e743e4b9-5ce8-4c82-8fe2-94a7f48a4d8d tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Going to try to terminate instance {{(pid=134666) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 13:43:18.214843 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-07770855-ab32-410b-a556-d8b8c8077534 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:18.222562 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-07770855-ab32-410b-a556-d8b8c8077534 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 200 len: 1264 microversion: 2.1 time: 0.156492 Jun 23 13:43:18.223125 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 252/484] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:18 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:43:18.287054 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-e743e4b9-5ce8-4c82-8fe2-94a7f48a4d8d tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa" status: 204 len: 0 microversion: 2.1 time: 0.123929 Jun 23 13:43:18.287695 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 233/485] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Jun 23 13:43:18 2022] DELETE /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 13:43:18.299162 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-48d6bae9-ceff-4213-97b0-9d3196520bc7 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:18.299803 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-48d6bae9-ceff-4213-97b0-9d3196520bc7 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:18.306385 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-48d6bae9-ceff-4213-97b0-9d3196520bc7 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:18.306832 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-48d6bae9-ceff-4213-97b0-9d3196520bc7 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:18.307617 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-48d6bae9-ceff-4213-97b0-9d3196520bc7 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:18.308041 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-48d6bae9-ceff-4213-97b0-9d3196520bc7 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:18.446376 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-48d6bae9-ceff-4213-97b0-9d3196520bc7 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:18.454131 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-48d6bae9-ceff-4213-97b0-9d3196520bc7 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa" status: 200 len: 1682 microversion: 2.1 time: 0.160804 Jun 23 13:43:18.454656 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 253/486] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:18 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:19.069424 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-e3c08f93-72bd-4972-b651-6490b1ed0ab6 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:19.070553 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-e3c08f93-72bd-4972-b651-6490b1ed0ab6 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:19.081333 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e3c08f93-72bd-4972-b651-6490b1ed0ab6 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:19.081801 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e3c08f93-72bd-4972-b651-6490b1ed0ab6 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:19.082561 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e3c08f93-72bd-4972-b651-6490b1ed0ab6 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:19.082995 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e3c08f93-72bd-4972-b651-6490b1ed0ab6 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:19.227498 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-e3c08f93-72bd-4972-b651-6490b1ed0ab6 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:19.236267 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-e3c08f93-72bd-4972-b651-6490b1ed0ab6 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1735 microversion: 2.1 time: 0.173920 Jun 23 13:43:19.236842 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 234/487] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:19 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:19.240005 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-e3567833-581d-45ba-ae2d-d9b95582c38e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:19.240624 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-e3567833-581d-45ba-ae2d-d9b95582c38e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:19.247257 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e3567833-581d-45ba-ae2d-d9b95582c38e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:19.247734 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e3567833-581d-45ba-ae2d-d9b95582c38e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:19.248489 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e3567833-581d-45ba-ae2d-d9b95582c38e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:19.248920 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e3567833-581d-45ba-ae2d-d9b95582c38e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:19.396479 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-e3567833-581d-45ba-ae2d-d9b95582c38e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:19.404517 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-e3567833-581d-45ba-ae2d-d9b95582c38e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 200 len: 1264 microversion: 2.1 time: 0.168396 Jun 23 13:43:19.405078 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 254/488] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:19 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:43:19.474252 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-314d7039-1000-4c19-a88d-b9b5d7f87e94 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:19.475094 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-314d7039-1000-4c19-a88d-b9b5d7f87e94 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:19.477726 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:43:19.485466 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-314d7039-1000-4c19-a88d-b9b5d7f87e94 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:19.486085 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-314d7039-1000-4c19-a88d-b9b5d7f87e94 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:19.487095 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-314d7039-1000-4c19-a88d-b9b5d7f87e94 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:19.487723 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-314d7039-1000-4c19-a88d-b9b5d7f87e94 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:19.622938 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-314d7039-1000-4c19-a88d-b9b5d7f87e94 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:19.630542 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-314d7039-1000-4c19-a88d-b9b5d7f87e94 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa" status: 200 len: 1682 microversion: 2.1 time: 0.161638 Jun 23 13:43:19.631074 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 235/489] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:19 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:20.258566 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-388d75ed-cf2e-4c34-8581-dead5bbf7243 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:20.259641 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-388d75ed-cf2e-4c34-8581-dead5bbf7243 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:20.269396 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-388d75ed-cf2e-4c34-8581-dead5bbf7243 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:20.269855 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-388d75ed-cf2e-4c34-8581-dead5bbf7243 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:20.270622 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-388d75ed-cf2e-4c34-8581-dead5bbf7243 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:20.271057 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-388d75ed-cf2e-4c34-8581-dead5bbf7243 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:20.404565 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-388d75ed-cf2e-4c34-8581-dead5bbf7243 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:20.415979 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-388d75ed-cf2e-4c34-8581-dead5bbf7243 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1735 microversion: 2.1 time: 0.164623 Jun 23 13:43:20.416558 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 255/490] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:20 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:20.421695 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-b8fbfcc8-caed-40b3-a23f-861326c15688 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:20.422463 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-b8fbfcc8-caed-40b3-a23f-861326c15688 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:20.429422 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b8fbfcc8-caed-40b3-a23f-861326c15688 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:20.429873 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b8fbfcc8-caed-40b3-a23f-861326c15688 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:20.430634 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b8fbfcc8-caed-40b3-a23f-861326c15688 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:20.431071 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b8fbfcc8-caed-40b3-a23f-861326c15688 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:20.569703 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-b8fbfcc8-caed-40b3-a23f-861326c15688 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:20.577557 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-b8fbfcc8-caed-40b3-a23f-861326c15688 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 200 len: 1264 microversion: 2.1 time: 0.159882 Jun 23 13:43:20.578100 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 236/491] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:20 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:20.655698 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-61b70e02-a1fe-4c7d-b107-e1c44d635ea3 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:20.656689 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-61b70e02-a1fe-4c7d-b107-e1c44d635ea3 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:20.663766 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-61b70e02-a1fe-4c7d-b107-e1c44d635ea3 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:20.664214 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-61b70e02-a1fe-4c7d-b107-e1c44d635ea3 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:20.664976 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-61b70e02-a1fe-4c7d-b107-e1c44d635ea3 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:20.665410 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-61b70e02-a1fe-4c7d-b107-e1c44d635ea3 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:20.797888 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-61b70e02-a1fe-4c7d-b107-e1c44d635ea3 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:20.806364 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-61b70e02-a1fe-4c7d-b107-e1c44d635ea3 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa" status: 200 len: 1682 microversion: 2.1 time: 0.157154 Jun 23 13:43:20.807039 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 256/492] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:20 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:21.437390 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-4a7db272-8733-4391-9bf3-795d5e4bcb71 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:21.438457 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-4a7db272-8733-4391-9bf3-795d5e4bcb71 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:21.445995 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4a7db272-8733-4391-9bf3-795d5e4bcb71 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:21.446461 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4a7db272-8733-4391-9bf3-795d5e4bcb71 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:21.447254 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4a7db272-8733-4391-9bf3-795d5e4bcb71 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:21.447735 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4a7db272-8733-4391-9bf3-795d5e4bcb71 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:21.579164 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-4a7db272-8733-4391-9bf3-795d5e4bcb71 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:21.591258 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-4a7db272-8733-4391-9bf3-795d5e4bcb71 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1735 microversion: 2.1 time: 0.160128 Jun 23 13:43:21.592129 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 237/493] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:21 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:21.596911 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-2bf3d6cd-eee9-46aa-9a2c-0c6f06ff8cb8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:21.597472 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-2bf3d6cd-eee9-46aa-9a2c-0c6f06ff8cb8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:21.604465 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2bf3d6cd-eee9-46aa-9a2c-0c6f06ff8cb8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:21.604926 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2bf3d6cd-eee9-46aa-9a2c-0c6f06ff8cb8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:21.605685 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2bf3d6cd-eee9-46aa-9a2c-0c6f06ff8cb8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:21.606126 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2bf3d6cd-eee9-46aa-9a2c-0c6f06ff8cb8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:21.738746 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-2bf3d6cd-eee9-46aa-9a2c-0c6f06ff8cb8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:21.746512 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-2bf3d6cd-eee9-46aa-9a2c-0c6f06ff8cb8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 200 len: 1264 microversion: 2.1 time: 0.155208 Jun 23 13:43:21.747087 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 257/494] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:21 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:21.824054 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-2624d79f-3c0c-4acd-9b5f-f79eb68d2a41 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:21.824695 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-2624d79f-3c0c-4acd-9b5f-f79eb68d2a41 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:21.830915 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2624d79f-3c0c-4acd-9b5f-f79eb68d2a41 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:21.831386 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2624d79f-3c0c-4acd-9b5f-f79eb68d2a41 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:21.832145 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2624d79f-3c0c-4acd-9b5f-f79eb68d2a41 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:21.832644 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2624d79f-3c0c-4acd-9b5f-f79eb68d2a41 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:21.930431 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-709202c7-0ee9-49e4-aad4-f9f9bfe17413 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2142734182", "imageRef": "dd7aacbf-3b3e-496e-967e-53d2a1b1f200", "flavorRef": "452", "networks": [{"uuid": "641a390d-373a-419e-893a-8f57c4838f1f"}]}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:43:21.972554 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-2624d79f-3c0c-4acd-9b5f-f79eb68d2a41 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:21.980147 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-2624d79f-3c0c-4acd-9b5f-f79eb68d2a41 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa" status: 200 len: 1682 microversion: 2.1 time: 0.160204 Jun 23 13:43:21.980422 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.network.neutron [None req-709202c7-0ee9-49e4-aad4-f9f9bfe17413 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] validate_networks() for [('641a390d-373a-419e-893a-8f57c4838f1f', None, None, None, None, None)] {{(pid=134667) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 13:43:21.980696 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 238/495] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:21 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:22.349299 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-709202c7-0ee9-49e4-aad4-f9f9bfe17413 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Flavor limits 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 13:43:22.349905 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-709202c7-0ee9-49e4-aad4-f9f9bfe17413 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Image limits 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 13:43:22.350477 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-709202c7-0ee9-49e4-aad4-f9f9bfe17413 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Flavor pref 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 13:43:22.350953 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-709202c7-0ee9-49e4-aad4-f9f9bfe17413 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Image pref 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 13:43:22.351533 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-709202c7-0ee9-49e4-aad4-f9f9bfe17413 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 13:43:22.360728 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-709202c7-0ee9-49e4-aad4-f9f9bfe17413 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:22.361249 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-709202c7-0ee9-49e4-aad4-f9f9bfe17413 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:22.362109 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-709202c7-0ee9-49e4-aad4-f9f9bfe17413 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:22.362608 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-709202c7-0ee9-49e4-aad4-f9f9bfe17413 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:22.381047 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.quota [None req-709202c7-0ee9-49e4-aad4-f9f9bfe17413 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Getting quotas for project 5ed01b7f521c413e944560db54281ebc. Resources: {'ram', 'cores', 'instances'} {{(pid=134667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:43:22.385139 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.quota [None req-709202c7-0ee9-49e4-aad4-f9f9bfe17413 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Getting quotas for user 7fd8fce7c040433e908a4fe6c6b13e08 and project 5ed01b7f521c413e944560db54281ebc. Resources: {'ram', 'cores', 'instances'} {{(pid=134667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:43:22.396761 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-709202c7-0ee9-49e4-aad4-f9f9bfe17413 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Going to run 1 instances... {{(pid=134667) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 13:43:22.399193 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-709202c7-0ee9-49e4-aad4-f9f9bfe17413 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: 7fb7c75c-c825-43e8-a4f0-43b5e62331a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7aacbf-3b3e-496e-967e-53d2a1b1f200',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134667) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 13:43:22.451097 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-709202c7-0ee9-49e4-aad4-f9f9bfe17413 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524462 Jun 23 13:43:22.452138 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 258/496] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Jun 23 13:43:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 13:43:22.468859 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-a799cb95-4408-49ee-8e6f-bacd6535a6a4 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:22.472396 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-a799cb95-4408-49ee-8e6f-bacd6535a6a4 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: 7fb7c75c-c825-43e8-a4f0-43b5e62331a9] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:22.532659 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-a799cb95-4408-49ee-8e6f-bacd6535a6a4 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:22.539457 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-a799cb95-4408-49ee-8e6f-bacd6535a6a4 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9" status: 200 len: 1219 microversion: 2.1 time: 0.079551 Jun 23 13:43:22.540026 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 239/497] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:22 2022] GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:43:22.610427 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-cc15437a-fe8c-4f38-aef3-bc12d9c0b01c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:22.612211 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-cc15437a-fe8c-4f38-aef3-bc12d9c0b01c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:22.619009 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-cc15437a-fe8c-4f38-aef3-bc12d9c0b01c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:22.619584 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-cc15437a-fe8c-4f38-aef3-bc12d9c0b01c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:22.620505 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-cc15437a-fe8c-4f38-aef3-bc12d9c0b01c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:22.621008 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-cc15437a-fe8c-4f38-aef3-bc12d9c0b01c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:22.765501 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-303ebc9e-50ac-4ce0-944e-8488bee5b3bb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:22.766452 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-303ebc9e-50ac-4ce0-944e-8488bee5b3bb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:22.773578 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-303ebc9e-50ac-4ce0-944e-8488bee5b3bb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:22.774268 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-303ebc9e-50ac-4ce0-944e-8488bee5b3bb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:22.774540 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-cc15437a-fe8c-4f38-aef3-bc12d9c0b01c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:22.775542 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-303ebc9e-50ac-4ce0-944e-8488bee5b3bb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:22.776260 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-303ebc9e-50ac-4ce0-944e-8488bee5b3bb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:22.785261 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-cc15437a-fe8c-4f38-aef3-bc12d9c0b01c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1735 microversion: 2.1 time: 0.179074 Jun 23 13:43:22.786442 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 259/498] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:22 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:22.946775 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-303ebc9e-50ac-4ce0-944e-8488bee5b3bb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:22.954468 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-303ebc9e-50ac-4ce0-944e-8488bee5b3bb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 200 len: 1264 microversion: 2.1 time: 0.193360 Jun 23 13:43:22.964133 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 240/499] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:22 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 1264 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:22.997473 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-3d870bdc-159f-4988-a16a-beec16908dd6 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:22.998349 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-3d870bdc-159f-4988-a16a-beec16908dd6 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:23.005437 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3d870bdc-159f-4988-a16a-beec16908dd6 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:23.006130 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3d870bdc-159f-4988-a16a-beec16908dd6 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:23.007030 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3d870bdc-159f-4988-a16a-beec16908dd6 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:23.007700 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3d870bdc-159f-4988-a16a-beec16908dd6 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:23.158226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-3d870bdc-159f-4988-a16a-beec16908dd6 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:23.167211 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-3d870bdc-159f-4988-a16a-beec16908dd6 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa" status: 200 len: 1682 microversion: 2.1 time: 0.173031 Jun 23 13:43:23.176761 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 260/500] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:22 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:23.558716 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-00b28662-f73b-4f7e-a302-43454e8dcfd6 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:23.560302 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-00b28662-f73b-4f7e-a302-43454e8dcfd6 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: 7fb7c75c-c825-43e8-a4f0-43b5e62331a9] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:23.570613 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-00b28662-f73b-4f7e-a302-43454e8dcfd6 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:23.571860 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-00b28662-f73b-4f7e-a302-43454e8dcfd6 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:23.572955 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-00b28662-f73b-4f7e-a302-43454e8dcfd6 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:23.573415 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-00b28662-f73b-4f7e-a302-43454e8dcfd6 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:23.657082 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-00b28662-f73b-4f7e-a302-43454e8dcfd6 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:23.664981 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-00b28662-f73b-4f7e-a302-43454e8dcfd6 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9" status: 200 len: 1279 microversion: 2.1 time: 0.112162 Jun 23 13:43:23.665736 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 241/501] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:23 2022] GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9 => generated 1279 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:23.802224 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-3dd528dc-3bd1-49ad-86a9-efc0aa76c4b4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:23.802787 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-3dd528dc-3bd1-49ad-86a9-efc0aa76c4b4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:23.809563 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3dd528dc-3bd1-49ad-86a9-efc0aa76c4b4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:23.810010 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3dd528dc-3bd1-49ad-86a9-efc0aa76c4b4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:23.810774 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3dd528dc-3bd1-49ad-86a9-efc0aa76c4b4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:23.811209 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3dd528dc-3bd1-49ad-86a9-efc0aa76c4b4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:23.942719 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-3dd528dc-3bd1-49ad-86a9-efc0aa76c4b4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:23.951103 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-3dd528dc-3bd1-49ad-86a9-efc0aa76c4b4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1735 microversion: 2.1 time: 0.152887 Jun 23 13:43:23.951669 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 261/502] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:23 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:23.971874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-f3677432-57f4-492b-912e-f27b339daf11 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:23.972658 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-f3677432-57f4-492b-912e-f27b339daf11 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:23.979046 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f3677432-57f4-492b-912e-f27b339daf11 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:23.979535 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f3677432-57f4-492b-912e-f27b339daf11 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:23.980306 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f3677432-57f4-492b-912e-f27b339daf11 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:23.980745 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f3677432-57f4-492b-912e-f27b339daf11 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:24.138393 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-f3677432-57f4-492b-912e-f27b339daf11 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:24.147702 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-f3677432-57f4-492b-912e-f27b339daf11 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 200 len: 1264 microversion: 2.1 time: 0.179823 Jun 23 13:43:24.148507 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 242/503] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:23 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:24.185609 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-3b9c43c8-1982-4789-8c68-afd4bedb5d74 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:24.186229 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-3b9c43c8-1982-4789-8c68-afd4bedb5d74 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:24.193448 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3b9c43c8-1982-4789-8c68-afd4bedb5d74 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:24.193904 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3b9c43c8-1982-4789-8c68-afd4bedb5d74 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:24.194701 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3b9c43c8-1982-4789-8c68-afd4bedb5d74 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:24.195132 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3b9c43c8-1982-4789-8c68-afd4bedb5d74 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:24.254873 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-2d68085d-c232-4cb9-b137-fe8ff98bcf3e req-31df9af2-3e70-44ad-b4e5-4599e1f2ce47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8dd165f-4996-4336-a117-cd2a9ba751fa", "name": "network-vif-deleted", "tag": "b21a6caf-efbc-4abd-ac6f-b37cb3962be9"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:43:24.272984 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-2d68085d-c232-4cb9-b137-fe8ff98bcf3e req-31df9af2-3e70-44ad-b4e5-4599e1f2ce47 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:24.278109 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-2d68085d-c232-4cb9-b137-fe8ff98bcf3e req-31df9af2-3e70-44ad-b4e5-4599e1f2ce47 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:24.294412 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-2d68085d-c232-4cb9-b137-fe8ff98bcf3e req-31df9af2-3e70-44ad-b4e5-4599e1f2ce47 service nova] Creating event network-vif-deleted:b21a6caf-efbc-4abd-ac6f-b37cb3962be9 for instance f8dd165f-4996-4336-a117-cd2a9ba751fa on hv-cinder-81558 Jun 23 13:43:24.308575 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-2d68085d-c232-4cb9-b137-fe8ff98bcf3e req-31df9af2-3e70-44ad-b4e5-4599e1f2ce47 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056915 Jun 23 13:43:24.313853 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 243/504] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 13:43:24.322132 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-3b9c43c8-1982-4789-8c68-afd4bedb5d74 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:24.330614 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-3b9c43c8-1982-4789-8c68-afd4bedb5d74 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa" status: 200 len: 1615 microversion: 2.1 time: 0.148911 Jun 23 13:43:24.341838 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 262/505] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:24 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa => generated 1615 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:24.500027 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-b1936914-3c53-4bb3-94f8-3d05767eba7e req-f45360ec-0458-4d74-bf01-1f9fcb6032b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42c29e33-917a-4263-a80c-9863ed228875", "name": "network-vif-plugged", "status": "completed", "tag": "e81f7986-69e2-48bc-88f6-03a52eb426dd"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:43:24.509634 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-b1936914-3c53-4bb3-94f8-3d05767eba7e req-f45360ec-0458-4d74-bf01-1f9fcb6032b7 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:24.510172 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-b1936914-3c53-4bb3-94f8-3d05767eba7e req-f45360ec-0458-4d74-bf01-1f9fcb6032b7 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:24.521865 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-b1936914-3c53-4bb3-94f8-3d05767eba7e req-f45360ec-0458-4d74-bf01-1f9fcb6032b7 service nova] Creating event network-vif-plugged:e81f7986-69e2-48bc-88f6-03a52eb426dd for instance 42c29e33-917a-4263-a80c-9863ed228875 on hv-cinder-81558 Jun 23 13:43:24.527293 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-b1936914-3c53-4bb3-94f8-3d05767eba7e req-f45360ec-0458-4d74-bf01-1f9fcb6032b7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031220 Jun 23 13:43:24.528030 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 244/506] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:43:24.683243 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-a693afb1-6cc4-4e94-bda9-c90b1ce5ecd4 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:24.684175 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-a693afb1-6cc4-4e94-bda9-c90b1ce5ecd4 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: 7fb7c75c-c825-43e8-a4f0-43b5e62331a9] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:24.692604 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a693afb1-6cc4-4e94-bda9-c90b1ce5ecd4 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:24.693060 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a693afb1-6cc4-4e94-bda9-c90b1ce5ecd4 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:24.693848 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a693afb1-6cc4-4e94-bda9-c90b1ce5ecd4 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:24.694289 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a693afb1-6cc4-4e94-bda9-c90b1ce5ecd4 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:24.848208 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-a693afb1-6cc4-4e94-bda9-c90b1ce5ecd4 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:24.862442 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-a693afb1-6cc4-4e94-bda9-c90b1ce5ecd4 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9" status: 200 len: 1319 microversion: 2.1 time: 0.182498 Jun 23 13:43:24.863775 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 263/507] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:24 2022] GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:24.969950 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-b11dba0b-9374-4ab4-9ee6-33bdb4ab2f7d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:24.970766 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-b11dba0b-9374-4ab4-9ee6-33bdb4ab2f7d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:24.978076 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b11dba0b-9374-4ab4-9ee6-33bdb4ab2f7d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:24.978857 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b11dba0b-9374-4ab4-9ee6-33bdb4ab2f7d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:24.979847 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b11dba0b-9374-4ab4-9ee6-33bdb4ab2f7d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:24.980469 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b11dba0b-9374-4ab4-9ee6-33bdb4ab2f7d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:25.141247 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-b11dba0b-9374-4ab4-9ee6-33bdb4ab2f7d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:25.150158 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-b11dba0b-9374-4ab4-9ee6-33bdb4ab2f7d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1735 microversion: 2.1 time: 0.184707 Jun 23 13:43:25.156809 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 245/508] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:24 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:25.165490 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-2582a5e0-df32-4bdf-aae1-83594c1a88d4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:25.166201 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-2582a5e0-df32-4bdf-aae1-83594c1a88d4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:25.173080 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2582a5e0-df32-4bdf-aae1-83594c1a88d4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:25.173658 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2582a5e0-df32-4bdf-aae1-83594c1a88d4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:25.174656 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2582a5e0-df32-4bdf-aae1-83594c1a88d4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:25.175294 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2582a5e0-df32-4bdf-aae1-83594c1a88d4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:25.329398 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-2582a5e0-df32-4bdf-aae1-83594c1a88d4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:25.338140 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-2582a5e0-df32-4bdf-aae1-83594c1a88d4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 200 len: 1264 microversion: 2.1 time: 0.176643 Jun 23 13:43:25.338970 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 264/509] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:25 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:25.348968 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-46b71777-d555-4602-adf5-1354ff44644b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:25.349574 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-46b71777-d555-4602-adf5-1354ff44644b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:25.355694 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-46b71777-d555-4602-adf5-1354ff44644b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:25.356325 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-46b71777-d555-4602-adf5-1354ff44644b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:25.357094 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-46b71777-d555-4602-adf5-1354ff44644b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:25.357520 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-46b71777-d555-4602-adf5-1354ff44644b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:25.371443 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.wsgi [None req-46b71777-d555-4602-adf5-1354ff44644b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] HTTP exception thrown: Instance f8dd165f-4996-4336-a117-cd2a9ba751fa could not be found. Jun 23 13:43:25.373377 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-46b71777-d555-4602-adf5-1354ff44644b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Request method failure captured: Jun 23 13:43:25.373377 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: request: GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa HTTP/1.1 Jun 23 13:43:25.373377 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept: application/json Jun 23 13:43:25.373377 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept-Encoding: identity Jun 23 13:43:25.373377 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Connection: close Jun 23 13:43:25.373377 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Length: 0 Jun 23 13:43:25.373377 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Type: application/json Jun 23 13:43:25.373377 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Host: 10.222.0.26 Jun 23 13:43:25.373377 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Openstack-System-Scope: None Jun 23 13:43:25.373377 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: User-Agent: python-urllib3/1.26.9 Jun 23 13:43:25.373377 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Auth-Token: gAAAAABitG0I_HZU131M8J85RvEQOmj8LgA_2WxO2JHaCALyqdLluOOVQseCnN3b49kmuLUwl7kgpYu_nyCOuFs2D4nvXDzPB-BFMJHg1SH6Biig2M0dk2RuXu07iB9rawZfYchoQTmmnBEWqWi0vz9e6Q6R4kGGzJ8cvnvjbn-HCeyXQcr5f7s Jun 23 13:43:25.373377 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Id: None Jun 23 13:43:25.373377 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Name: None Jun 23 13:43:25.373377 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Identity-Status: Confirmed Jun 23 13:43:25.373377 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Is-Admin-Project: True Jun 23 13:43:25.373377 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Id: default Jun 23 13:43:25.373377 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Name: Default Jun 23 13:43:25.373377 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Id: 9298bf4635e84993b086309715cc7cbe Jun 23 13:43:25.373377 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Name: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:43:25.373377 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Role: member,reader Jun 23 13:43:25.373377 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Roles: member,reader Jun 23 13:43:25.374861 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9298bf4635e84993b086309715cc7cbe", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:43:25.374861 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:43:25.374861 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Id: 9298bf4635e84993b086309715cc7cbe Jun 23 13:43:25.374861 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:43:25.374861 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User: tempest-AttachVolumeNegativeTest-1741631114-project Jun 23 13:43:25.374861 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Id: default Jun 23 13:43:25.374861 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Name: Default Jun 23 13:43:25.374861 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Id: 007ce9b8109343e0914efe94c6aa6a89 Jun 23 13:43:25.374861 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Name: tempest-AttachVolumeNegativeTest-1741631114-project Jun 23 13:43:25.374861 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: method: > Jun 23 13:43:25.374861 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: exception: Instance f8dd165f-4996-4336-a117-cd2a9ba751fa could not be found. Jun 23 13:43:25.374861 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: action_args: {'id': 'f8dd165f-4996-4336-a117-cd2a9ba751fa'} Jun 23 13:43:25.375702 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:43:25.375702 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:43:25.375702 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:43:25.375702 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:43:25.375702 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:43:25.375702 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:43:25.375702 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:43:25.375702 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:43:25.375702 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:43:25.375702 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:43:25.375702 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8dd165f-4996-4336-a117-cd2a9ba751fa could not be found. Jun 23 13:43:25.375702 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:43:25.375702 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:43:25.375702 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:43:25.375702 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:43:25.375702 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:43:25.375702 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:43:25.375702 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:43:25.375702 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:43:25.375702 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:43:25.376963 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:43:25.376963 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:43:25.376963 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:43:25.376963 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:43:25.376963 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:43:25.376963 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:43:25.376963 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:43:25.376963 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8dd165f-4996-4336-a117-cd2a9ba751fa could not be found. Jun 23 13:43:25.376963 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:43:25.376963 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:43:25.376963 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:43:25.376963 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:43:25.376963 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:43:25.376963 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:43:25.376963 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:43:25.376963 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:43:25.376963 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8dd165f-4996-4336-a117-cd2a9ba751fa could not be found. Jun 23 13:43:25.376963 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:43:25.377985 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-46b71777-d555-4602-adf5-1354ff44644b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Returning 404 to user: Instance f8dd165f-4996-4336-a117-cd2a9ba751fa could not be found. {{(pid=134666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:43:25.377985 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-46b71777-d555-4602-adf5-1354ff44644b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa" status: 404 len: 111 microversion: 2.1 time: 0.029870 Jun 23 13:43:25.377985 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 246/510] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:25 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:43:25.385265 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-8faf9a12-835e-42f1-a97a-f338b917673c tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '.version_select at 0x7fd7724793a0>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:25.409511 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-8faf9a12-835e-42f1-a97a-f338b917673c tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1534996295" status: 202 len: 0 microversion: 2.1 time: 0.029329 Jun 23 13:43:25.410431 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 265/511] 10.222.0.26 () {58 vars in 1220 bytes} [Thu Jun 23 13:43:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1534996295 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 13:43:25.879993 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-ab63a246-5fe0-4680-b511-0fddd811f85c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:25.880516 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-ab63a246-5fe0-4680-b511-0fddd811f85c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: 7fb7c75c-c825-43e8-a4f0-43b5e62331a9] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:25.887131 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ab63a246-5fe0-4680-b511-0fddd811f85c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:25.887609 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ab63a246-5fe0-4680-b511-0fddd811f85c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:25.888348 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ab63a246-5fe0-4680-b511-0fddd811f85c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:25.888814 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ab63a246-5fe0-4680-b511-0fddd811f85c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:26.076700 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-ab63a246-5fe0-4680-b511-0fddd811f85c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:26.085679 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-ab63a246-5fe0-4680-b511-0fddd811f85c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9" status: 200 len: 1319 microversion: 2.1 time: 0.209607 Jun 23 13:43:26.086355 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 247/512] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:25 2022] GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:26.168533 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-6c06a65d-d144-48b6-a480-1c1799b8c1f1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:26.169884 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-6c06a65d-d144-48b6-a480-1c1799b8c1f1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:26.178702 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6c06a65d-d144-48b6-a480-1c1799b8c1f1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:26.179253 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6c06a65d-d144-48b6-a480-1c1799b8c1f1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:26.180291 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6c06a65d-d144-48b6-a480-1c1799b8c1f1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:26.180831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6c06a65d-d144-48b6-a480-1c1799b8c1f1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:26.258443 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-149278a8-7553-496f-9428-4bdb0e8e3ab7 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Action: 'create', calling method: .version_select at 0x7fd7724a4160>, body: {"keypair": {"name": "tempest-keypair-1907845218", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDuSx3/qPNOXop3WkFLn45jmUbPuX81z9R9yVOXgtKBEDjhfVRlrhVKdlr3zhIrCeNyD30533H1vScEqSrr/d1V+BP+CCJobd6Vfv/dW7fSOFCLIkPOgEVpYnUOH+QK1g=="}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:43:26.274274 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-149278a8-7553-496f-9428-4bdb0e8e3ab7 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Getting quotas for project 9298bf4635e84993b086309715cc7cbe. Resources: {'key_pairs'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:43:26.278377 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-149278a8-7553-496f-9428-4bdb0e8e3ab7 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Getting quotas for user 007ce9b8109343e0914efe94c6aa6a89 and project 9298bf4635e84993b086309715cc7cbe. Resources: {'key_pairs'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:43:26.301181 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-149278a8-7553-496f-9428-4bdb0e8e3ab7 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048337 Jun 23 13:43:26.303728 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 248/513] 10.222.0.26 () {60 vars in 1158 bytes} [Thu Jun 23 13:43:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:43:26.330702 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-c72acdae-980d-4d10-a1a3-e1359cc96e7d req-6f21360c-b720-468d-9b04-19465173b87e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fb7c75c-c825-43e8-a4f0-43b5e62331a9", "tag": "88903506-2ee3-475a-84a2-3a390f1bd829"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:43:26.339848 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-c72acdae-980d-4d10-a1a3-e1359cc96e7d req-6f21360c-b720-468d-9b04-19465173b87e service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:26.340387 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-c72acdae-980d-4d10-a1a3-e1359cc96e7d req-6f21360c-b720-468d-9b04-19465173b87e service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:26.352525 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-6c06a65d-d144-48b6-a480-1c1799b8c1f1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:26.352935 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-c72acdae-980d-4d10-a1a3-e1359cc96e7d req-6f21360c-b720-468d-9b04-19465173b87e service nova] Creating event network-changed:88903506-2ee3-475a-84a2-3a390f1bd829 for instance 7fb7c75c-c825-43e8-a4f0-43b5e62331a9 on hv-cinder-81558 Jun 23 13:43:26.357883 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-c72acdae-980d-4d10-a1a3-e1359cc96e7d req-6f21360c-b720-468d-9b04-19465173b87e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031137 Jun 23 13:43:26.358716 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 249/514] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 13:43:26.361975 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-6c06a65d-d144-48b6-a480-1c1799b8c1f1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1735 microversion: 2.1 time: 0.198166 Jun 23 13:43:26.363984 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-30d5aad3-1eda-4e7d-9715-6136c1824834 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:26.364683 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-30d5aad3-1eda-4e7d-9715-6136c1824834 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:26.365496 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 266/515] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:26 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:26.370928 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-30d5aad3-1eda-4e7d-9715-6136c1824834 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:26.371431 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-30d5aad3-1eda-4e7d-9715-6136c1824834 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:26.372199 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-30d5aad3-1eda-4e7d-9715-6136c1824834 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:26.372637 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-30d5aad3-1eda-4e7d-9715-6136c1824834 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:26.550749 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-30d5aad3-1eda-4e7d-9715-6136c1824834 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:26.558469 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-30d5aad3-1eda-4e7d-9715-6136c1824834 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 200 len: 1264 microversion: 2.1 time: 0.198665 Jun 23 13:43:26.559049 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 250/516] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:26 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 1264 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:27.102431 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-5102bac3-35c3-4ea2-9df6-8ee5f657c2a9 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:27.103044 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-5102bac3-35c3-4ea2-9df6-8ee5f657c2a9 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: 7fb7c75c-c825-43e8-a4f0-43b5e62331a9] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:27.109459 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5102bac3-35c3-4ea2-9df6-8ee5f657c2a9 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:27.109909 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5102bac3-35c3-4ea2-9df6-8ee5f657c2a9 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:27.110742 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5102bac3-35c3-4ea2-9df6-8ee5f657c2a9 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:27.111713 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5102bac3-35c3-4ea2-9df6-8ee5f657c2a9 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:27.246976 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-5102bac3-35c3-4ea2-9df6-8ee5f657c2a9 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:27.256337 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-5102bac3-35c3-4ea2-9df6-8ee5f657c2a9 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9" status: 200 len: 1319 microversion: 2.1 time: 0.157734 Jun 23 13:43:27.257152 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 267/517] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:27 2022] GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:27.381561 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-38f1fa28-8142-4b46-9d75-099fa3bda6d8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:27.382149 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-38f1fa28-8142-4b46-9d75-099fa3bda6d8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:27.390617 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-38f1fa28-8142-4b46-9d75-099fa3bda6d8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:27.391061 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-38f1fa28-8142-4b46-9d75-099fa3bda6d8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:27.391919 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-38f1fa28-8142-4b46-9d75-099fa3bda6d8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:27.392354 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-38f1fa28-8142-4b46-9d75-099fa3bda6d8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:27.529540 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-38f1fa28-8142-4b46-9d75-099fa3bda6d8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:27.538148 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-38f1fa28-8142-4b46-9d75-099fa3bda6d8 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1735 microversion: 2.1 time: 0.160366 Jun 23 13:43:27.538736 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 251/518] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:27 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:27.574620 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-384dbf75-d3ff-4529-87d4-565eb828692e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:27.575500 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-384dbf75-d3ff-4529-87d4-565eb828692e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:27.582071 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-384dbf75-d3ff-4529-87d4-565eb828692e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:27.582585 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-384dbf75-d3ff-4529-87d4-565eb828692e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:27.583302 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-384dbf75-d3ff-4529-87d4-565eb828692e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:27.584064 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-384dbf75-d3ff-4529-87d4-565eb828692e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:27.600188 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:43:27.722632 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-384dbf75-d3ff-4529-87d4-565eb828692e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:27.731131 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-384dbf75-d3ff-4529-87d4-565eb828692e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 200 len: 1451 microversion: 2.1 time: 0.160430 Jun 23 13:43:27.731758 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 268/519] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:27 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:27.747720 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-5b1e5c29-cc83-4c3a-b2c7-7bf687feb80f tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:27.748322 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-5b1e5c29-cc83-4c3a-b2c7-7bf687feb80f tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:27.754877 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5b1e5c29-cc83-4c3a-b2c7-7bf687feb80f tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:27.755464 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5b1e5c29-cc83-4c3a-b2c7-7bf687feb80f tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:27.756251 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5b1e5c29-cc83-4c3a-b2c7-7bf687feb80f tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:27.756694 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5b1e5c29-cc83-4c3a-b2c7-7bf687feb80f tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:27.774679 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:43:27.923045 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-5b1e5c29-cc83-4c3a-b2c7-7bf687feb80f tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:27.931094 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-5b1e5c29-cc83-4c3a-b2c7-7bf687feb80f tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 200 len: 1451 microversion: 2.1 time: 0.187307 Jun 23 13:43:27.931714 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 252/520] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:27 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 1451 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:28.226546 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-d7e0ac64-9f56-4698-bbfc-d9e7b486fa6a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1208482835", "imageRef": "dd7aacbf-3b3e-496e-967e-53d2a1b1f200", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "750f6de3-a7e6-4721-b369-b46085e03f9a"}], "security_groups": [{"name": "tempest-securitygroup--1830608769"}], "key_name": "tempest-keypair-1907845218", "user_data": "}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:43:28.276015 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-dc1f0c63-6a56-42f6-aff3-e104f62def87 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:28.277358 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-dc1f0c63-6a56-42f6-aff3-e104f62def87 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: 7fb7c75c-c825-43e8-a4f0-43b5e62331a9] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:28.286795 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-dc1f0c63-6a56-42f6-aff3-e104f62def87 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:28.287631 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-dc1f0c63-6a56-42f6-aff3-e104f62def87 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:28.288051 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-dc1f0c63-6a56-42f6-aff3-e104f62def87 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:28.288489 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-dc1f0c63-6a56-42f6-aff3-e104f62def87 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:28.415552 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.network.neutron [None req-d7e0ac64-9f56-4698-bbfc-d9e7b486fa6a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] validate_networks() for [('750f6de3-a7e6-4721-b369-b46085e03f9a', None, None, None, None, None)] {{(pid=134667) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 13:43:28.579085 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-dc1f0c63-6a56-42f6-aff3-e104f62def87 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:28.587552 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-dc1f0c63-6a56-42f6-aff3-e104f62def87 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9" status: 200 len: 1319 microversion: 2.1 time: 0.317906 Jun 23 13:43:28.588049 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 253/521] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:28 2022] GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9 => generated 1319 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:28.592509 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-7e9d2ff7-3ba4-46c4-9a80-82b56c97f460 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:28.593092 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-7e9d2ff7-3ba4-46c4-9a80-82b56c97f460 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:28.599433 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7e9d2ff7-3ba4-46c4-9a80-82b56c97f460 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:28.600111 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7e9d2ff7-3ba4-46c4-9a80-82b56c97f460 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:28.600862 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7e9d2ff7-3ba4-46c4-9a80-82b56c97f460 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:28.601357 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7e9d2ff7-3ba4-46c4-9a80-82b56c97f460 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:29.111667 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-7e9d2ff7-3ba4-46c4-9a80-82b56c97f460 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:29.121433 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-7e9d2ff7-3ba4-46c4-9a80-82b56c97f460 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1592 microversion: 2.1 time: 0.532391 Jun 23 13:43:29.121995 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 254/522] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:28 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1592 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:29.126937 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-a43b6c78-cac0-4d00-ba0c-94a0992c09a0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:29.127740 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-a43b6c78-cac0-4d00-ba0c-94a0992c09a0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:29.134106 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a43b6c78-cac0-4d00-ba0c-94a0992c09a0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:29.134804 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a43b6c78-cac0-4d00-ba0c-94a0992c09a0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:29.136969 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a43b6c78-cac0-4d00-ba0c-94a0992c09a0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:29.137621 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a43b6c78-cac0-4d00-ba0c-94a0992c09a0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:29.479662 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-d7e0ac64-9f56-4698-bbfc-d9e7b486fa6a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Flavor limits 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 13:43:29.480661 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-d7e0ac64-9f56-4698-bbfc-d9e7b486fa6a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Image limits 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 13:43:29.481184 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-d7e0ac64-9f56-4698-bbfc-d9e7b486fa6a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Flavor pref 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 13:43:29.481633 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-d7e0ac64-9f56-4698-bbfc-d9e7b486fa6a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Image pref 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 13:43:29.482216 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-d7e0ac64-9f56-4698-bbfc-d9e7b486fa6a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 13:43:29.492533 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d7e0ac64-9f56-4698-bbfc-d9e7b486fa6a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:29.493252 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d7e0ac64-9f56-4698-bbfc-d9e7b486fa6a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:29.494344 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d7e0ac64-9f56-4698-bbfc-d9e7b486fa6a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:29.495294 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d7e0ac64-9f56-4698-bbfc-d9e7b486fa6a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:29.512778 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-a43b6c78-cac0-4d00-ba0c-94a0992c09a0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:29.518566 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.quota [None req-d7e0ac64-9f56-4698-bbfc-d9e7b486fa6a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Getting quotas for project 9298bf4635e84993b086309715cc7cbe. Resources: {'ram', 'cores', 'instances'} {{(pid=134667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:43:29.524218 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-a43b6c78-cac0-4d00-ba0c-94a0992c09a0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1735 microversion: 2.1 time: 0.400348 Jun 23 13:43:29.524753 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.quota [None req-d7e0ac64-9f56-4698-bbfc-d9e7b486fa6a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Getting quotas for user 007ce9b8109343e0914efe94c6aa6a89 and project 9298bf4635e84993b086309715cc7cbe. Resources: {'ram', 'cores', 'instances'} {{(pid=134667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:43:29.525015 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 255/523] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:29 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1735 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:29.540189 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-d7e0ac64-9f56-4698-bbfc-d9e7b486fa6a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Going to run 1 instances... {{(pid=134667) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 13:43:29.542322 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-d7e0ac64-9f56-4698-bbfc-d9e7b486fa6a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7aacbf-3b3e-496e-967e-53d2a1b1f200',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134667) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 13:43:29.596480 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-d7e0ac64-9f56-4698-bbfc-d9e7b486fa6a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.374163 Jun 23 13:43:29.597512 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 269/524] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Jun 23 13:43:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 1376 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 13:43:29.613720 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-51f2e498-57db-427f-bdaa-83a26b702480 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:29.614472 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-51f2e498-57db-427f-bdaa-83a26b702480 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:29.627938 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-3aba2289-c789-42ef-8756-fcf22f87e2f0 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:29.630250 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-3aba2289-c789-42ef-8756-fcf22f87e2f0 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: 7fb7c75c-c825-43e8-a4f0-43b5e62331a9] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:29.652875 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3aba2289-c789-42ef-8756-fcf22f87e2f0 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:29.653661 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3aba2289-c789-42ef-8756-fcf22f87e2f0 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:29.655304 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3aba2289-c789-42ef-8756-fcf22f87e2f0 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:29.655841 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3aba2289-c789-42ef-8756-fcf22f87e2f0 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:29.713481 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-51f2e498-57db-427f-bdaa-83a26b702480 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:29.722842 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-51f2e498-57db-427f-bdaa-83a26b702480 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528" status: 200 len: 1242 microversion: 2.1 time: 0.117141 Jun 23 13:43:29.733053 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 256/525] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:29 2022] GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528 => generated 1242 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:29.933202 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-3aba2289-c789-42ef-8756-fcf22f87e2f0 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:29.942818 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-3aba2289-c789-42ef-8756-fcf22f87e2f0 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9" status: 200 len: 1319 microversion: 2.1 time: 0.324381 Jun 23 13:43:29.944082 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 270/526] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:29 2022] GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9 => generated 1319 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:30.541879 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-2902a883-dc9f-414c-8090-fa963894f2ea tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:30.542686 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-2902a883-dc9f-414c-8090-fa963894f2ea tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:30.553705 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2902a883-dc9f-414c-8090-fa963894f2ea tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:30.554166 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2902a883-dc9f-414c-8090-fa963894f2ea tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:30.554979 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2902a883-dc9f-414c-8090-fa963894f2ea tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:30.555720 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2902a883-dc9f-414c-8090-fa963894f2ea tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:30.741140 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-22f5ce74-af6f-42f8-b59c-f4037f684eb8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:30.742429 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-22f5ce74-af6f-42f8-b59c-f4037f684eb8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:30.754632 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-22f5ce74-af6f-42f8-b59c-f4037f684eb8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:30.758987 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-22f5ce74-af6f-42f8-b59c-f4037f684eb8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:30.759862 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-22f5ce74-af6f-42f8-b59c-f4037f684eb8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:30.760474 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-22f5ce74-af6f-42f8-b59c-f4037f684eb8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:30.822931 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-2902a883-dc9f-414c-8090-fa963894f2ea tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:30.832295 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-2902a883-dc9f-414c-8090-fa963894f2ea tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1735 microversion: 2.1 time: 0.294296 Jun 23 13:43:30.845774 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-22f5ce74-af6f-42f8-b59c-f4037f684eb8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:30.846887 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 257/527] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:30 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1735 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:30.849124 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-22f5ce74-af6f-42f8-b59c-f4037f684eb8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528" status: 200 len: 1302 microversion: 2.1 time: 0.112736 Jun 23 13:43:30.851460 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 271/528] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:30 2022] GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528 => generated 1302 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:43:30.853451 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-d4aa6a16-b1f2-49bb-bc98-91ec55de6be0 req-fe03f5d8-18ba-4245-b382-8dac897bf491 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42c29e33-917a-4263-a80c-9863ed228875", "tag": "e81f7986-69e2-48bc-88f6-03a52eb426dd"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:43:30.864794 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-d4aa6a16-b1f2-49bb-bc98-91ec55de6be0 req-fe03f5d8-18ba-4245-b382-8dac897bf491 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:30.865565 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-d4aa6a16-b1f2-49bb-bc98-91ec55de6be0 req-fe03f5d8-18ba-4245-b382-8dac897bf491 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:30.878671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-d4aa6a16-b1f2-49bb-bc98-91ec55de6be0 req-fe03f5d8-18ba-4245-b382-8dac897bf491 service nova] Creating event network-changed:e81f7986-69e2-48bc-88f6-03a52eb426dd for instance 42c29e33-917a-4263-a80c-9863ed228875 on hv-cinder-81558 Jun 23 13:43:30.884085 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-d4aa6a16-b1f2-49bb-bc98-91ec55de6be0 req-fe03f5d8-18ba-4245-b382-8dac897bf491 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035599 Jun 23 13:43:30.885093 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 258/529] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:43:30.962847 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-c023fd21-4fbc-4fbf-91d1-ad66be1a7b94 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:30.963505 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-c023fd21-4fbc-4fbf-91d1-ad66be1a7b94 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: 7fb7c75c-c825-43e8-a4f0-43b5e62331a9] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:30.974641 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c023fd21-4fbc-4fbf-91d1-ad66be1a7b94 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:30.975784 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c023fd21-4fbc-4fbf-91d1-ad66be1a7b94 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:30.976655 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c023fd21-4fbc-4fbf-91d1-ad66be1a7b94 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:30.977157 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c023fd21-4fbc-4fbf-91d1-ad66be1a7b94 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:31.134540 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-c023fd21-4fbc-4fbf-91d1-ad66be1a7b94 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:31.143163 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-c023fd21-4fbc-4fbf-91d1-ad66be1a7b94 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9" status: 200 len: 1319 microversion: 2.1 time: 0.185607 Jun 23 13:43:31.143778 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 272/530] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:30 2022] GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:31.854701 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c8a742c9-e56d-4e37-9415-1e906da164bc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:31.855525 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-c8a742c9-e56d-4e37-9415-1e906da164bc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:31.862673 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c8a742c9-e56d-4e37-9415-1e906da164bc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:31.863124 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c8a742c9-e56d-4e37-9415-1e906da164bc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:31.863989 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c8a742c9-e56d-4e37-9415-1e906da164bc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:31.864591 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c8a742c9-e56d-4e37-9415-1e906da164bc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:31.868467 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-5c6974c6-579e-4882-ba3b-3cfd0992c58a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:31.869337 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-5c6974c6-579e-4882-ba3b-3cfd0992c58a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:31.877161 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5c6974c6-579e-4882-ba3b-3cfd0992c58a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:31.878088 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5c6974c6-579e-4882-ba3b-3cfd0992c58a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:31.879057 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5c6974c6-579e-4882-ba3b-3cfd0992c58a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:31.879690 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5c6974c6-579e-4882-ba3b-3cfd0992c58a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:31.978073 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-5c6974c6-579e-4882-ba3b-3cfd0992c58a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:31.989533 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-5c6974c6-579e-4882-ba3b-3cfd0992c58a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528" status: 200 len: 1300 microversion: 2.1 time: 0.125739 Jun 23 13:43:31.990778 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 273/531] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:31 2022] GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528 => generated 1300 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:32.046539 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-c8a742c9-e56d-4e37-9415-1e906da164bc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:32.058103 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-c8a742c9-e56d-4e37-9415-1e906da164bc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1735 microversion: 2.1 time: 0.208492 Jun 23 13:43:32.059680 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 259/532] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:31 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1735 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:32.160088 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-12ba06b0-7514-44e1-b81a-11147d9aa8fc tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:32.160681 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-12ba06b0-7514-44e1-b81a-11147d9aa8fc tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: 7fb7c75c-c825-43e8-a4f0-43b5e62331a9] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:32.169209 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-12ba06b0-7514-44e1-b81a-11147d9aa8fc tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:32.169650 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-12ba06b0-7514-44e1-b81a-11147d9aa8fc tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:32.170615 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-12ba06b0-7514-44e1-b81a-11147d9aa8fc tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:32.171220 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-12ba06b0-7514-44e1-b81a-11147d9aa8fc tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:32.201526 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-2f83d8ab-2ae8-46b3-b0e9-c675aab0d39b req-f646792c-7e2f-4b5a-ab69-ff4c895ac842 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01f7b0a9-1671-460d-8a52-541dc119c6f6", "tag": "f801c0fd-febc-4835-97ee-811b19175e3e"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:43:32.219916 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-2f83d8ab-2ae8-46b3-b0e9-c675aab0d39b req-f646792c-7e2f-4b5a-ab69-ff4c895ac842 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:32.220362 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-2f83d8ab-2ae8-46b3-b0e9-c675aab0d39b req-f646792c-7e2f-4b5a-ab69-ff4c895ac842 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:32.237677 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-2f83d8ab-2ae8-46b3-b0e9-c675aab0d39b req-f646792c-7e2f-4b5a-ab69-ff4c895ac842 service nova] Creating event network-changed:f801c0fd-febc-4835-97ee-811b19175e3e for instance 01f7b0a9-1671-460d-8a52-541dc119c6f6 on hv-cinder-81558 Jun 23 13:43:32.244568 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-2f83d8ab-2ae8-46b3-b0e9-c675aab0d39b req-f646792c-7e2f-4b5a-ab69-ff4c895ac842 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046682 Jun 23 13:43:32.245382 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 260/533] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 13:43:32.396496 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-12ba06b0-7514-44e1-b81a-11147d9aa8fc tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:32.405433 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-12ba06b0-7514-44e1-b81a-11147d9aa8fc tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9" status: 200 len: 1319 microversion: 2.1 time: 0.249204 Jun 23 13:43:32.406021 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 274/534] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:32 2022] GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9 => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:32.677773 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-384db4ba-91f5-44a1-a61f-90acd2cf11a0 req-cabc5779-6c03-44c1-9bb9-c174bf390fcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fb7c75c-c825-43e8-a4f0-43b5e62331a9", "name": "network-vif-plugged", "status": "completed", "tag": "88903506-2ee3-475a-84a2-3a390f1bd829"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:43:32.706394 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-384db4ba-91f5-44a1-a61f-90acd2cf11a0 req-cabc5779-6c03-44c1-9bb9-c174bf390fcf service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:32.708650 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-384db4ba-91f5-44a1-a61f-90acd2cf11a0 req-cabc5779-6c03-44c1-9bb9-c174bf390fcf service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:32.733429 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-384db4ba-91f5-44a1-a61f-90acd2cf11a0 req-cabc5779-6c03-44c1-9bb9-c174bf390fcf service nova] Creating event network-vif-plugged:88903506-2ee3-475a-84a2-3a390f1bd829 for instance 7fb7c75c-c825-43e8-a4f0-43b5e62331a9 on hv-cinder-81558 Jun 23 13:43:32.743600 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-384db4ba-91f5-44a1-a61f-90acd2cf11a0 req-cabc5779-6c03-44c1-9bb9-c174bf390fcf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075921 Jun 23 13:43:32.744575 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 261/535] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:43:33.006859 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-f75e7ba5-5420-4079-b807-95ed272ed134 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:33.007588 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-f75e7ba5-5420-4079-b807-95ed272ed134 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:33.016530 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f75e7ba5-5420-4079-b807-95ed272ed134 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:33.017255 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f75e7ba5-5420-4079-b807-95ed272ed134 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:33.018397 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f75e7ba5-5420-4079-b807-95ed272ed134 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:33.019026 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f75e7ba5-5420-4079-b807-95ed272ed134 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:33.077771 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-4523b748-c189-4e8d-a6fc-620a286581ab tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:33.079163 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-4523b748-c189-4e8d-a6fc-620a286581ab tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:33.098346 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4523b748-c189-4e8d-a6fc-620a286581ab tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:33.103380 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4523b748-c189-4e8d-a6fc-620a286581ab tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:33.104790 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4523b748-c189-4e8d-a6fc-620a286581ab tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:33.105590 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4523b748-c189-4e8d-a6fc-620a286581ab tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:33.237338 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-f75e7ba5-5420-4079-b807-95ed272ed134 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:33.246220 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-f75e7ba5-5420-4079-b807-95ed272ed134 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528" status: 200 len: 1368 microversion: 2.1 time: 0.243864 Jun 23 13:43:33.255771 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 275/536] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:33 2022] GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528 => generated 1368 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:33.312897 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-4523b748-c189-4e8d-a6fc-620a286581ab tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:33.322701 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-4523b748-c189-4e8d-a6fc-620a286581ab tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1735 microversion: 2.1 time: 0.249769 Jun 23 13:43:33.323951 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 262/537] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:33 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1735 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:43:33.421952 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-9b4b1105-104a-4808-874b-4e89df9aa1c0 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:33.422563 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-9b4b1105-104a-4808-874b-4e89df9aa1c0 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: 7fb7c75c-c825-43e8-a4f0-43b5e62331a9] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:33.430178 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9b4b1105-104a-4808-874b-4e89df9aa1c0 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:33.430855 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9b4b1105-104a-4808-874b-4e89df9aa1c0 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:33.438584 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9b4b1105-104a-4808-874b-4e89df9aa1c0 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:33.441057 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9b4b1105-104a-4808-874b-4e89df9aa1c0 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:33.660674 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-9b4b1105-104a-4808-874b-4e89df9aa1c0 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:33.670189 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-9b4b1105-104a-4808-874b-4e89df9aa1c0 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9" status: 200 len: 1319 microversion: 2.1 time: 0.252044 Jun 23 13:43:33.672202 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 276/538] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:33 2022] GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:33.971833 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-0c0cca34-95c5-4c67-9d05-49d259168548 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-999735637"}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:43:33.972450 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-0c0cca34-95c5-4c67-9d05-49d259168548 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:33.978776 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0c0cca34-95c5-4c67-9d05-49d259168548 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:33.979306 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0c0cca34-95c5-4c67-9d05-49d259168548 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:33.980111 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0c0cca34-95c5-4c67-9d05-49d259168548 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:33.980548 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0c0cca34-95c5-4c67-9d05-49d259168548 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:34.112728 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.network.security_group_api [None req-0c0cca34-95c5-4c67-9d05-49d259168548 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Adding security group 2037daa1-989f-4490-8a83-7c780e7cebde to port f801c0fd-febc-4835-97ee-811b19175e3e Jun 23 13:43:34.261928 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-57ad879b-3ed6-49ab-bcfb-234d740c14c0 req-93b33c1f-9cce-4d65-a373-e9f7b009ebc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d2cbd7f-a2a8-4a8e-beea-655a691d1528", "tag": "11905686-c708-4716-8310-c8bbd7705aa0"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:43:34.272750 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-57ad879b-3ed6-49ab-bcfb-234d740c14c0 req-93b33c1f-9cce-4d65-a373-e9f7b009ebc3 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:34.273291 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-57ad879b-3ed6-49ab-bcfb-234d740c14c0 req-93b33c1f-9cce-4d65-a373-e9f7b009ebc3 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:34.286843 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-57ad879b-3ed6-49ab-bcfb-234d740c14c0 req-93b33c1f-9cce-4d65-a373-e9f7b009ebc3 service nova] Creating event network-changed:11905686-c708-4716-8310-c8bbd7705aa0 for instance 2d2cbd7f-a2a8-4a8e-beea-655a691d1528 on hv-cinder-81558 Jun 23 13:43:34.292758 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-57ad879b-3ed6-49ab-bcfb-234d740c14c0 req-93b33c1f-9cce-4d65-a373-e9f7b009ebc3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034641 Jun 23 13:43:34.295100 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 277/539] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:43:34.300493 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-78a160d3-f1ac-4374-9e00-858625711205 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:34.300948 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-78a160d3-f1ac-4374-9e00-858625711205 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:34.308375 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-78a160d3-f1ac-4374-9e00-858625711205 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:34.308839 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-78a160d3-f1ac-4374-9e00-858625711205 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:34.309641 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-78a160d3-f1ac-4374-9e00-858625711205 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:34.310075 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-78a160d3-f1ac-4374-9e00-858625711205 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:34.741113 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-78a160d3-f1ac-4374-9e00-858625711205 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:34.749558 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-78a160d3-f1ac-4374-9e00-858625711205 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528" status: 200 len: 1368 microversion: 2.1 time: 0.453228 Jun 23 13:43:34.750386 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 278/540] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:34 2022] GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528 => generated 1368 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:34.757104 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-bb75c742-457b-4187-a334-da025e94f577 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:34.758113 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-bb75c742-457b-4187-a334-da025e94f577 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:34.765168 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bb75c742-457b-4187-a334-da025e94f577 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:34.765621 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bb75c742-457b-4187-a334-da025e94f577 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:34.766469 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bb75c742-457b-4187-a334-da025e94f577 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:34.766902 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bb75c742-457b-4187-a334-da025e94f577 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:34.807147 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-0c0cca34-95c5-4c67-9d05-49d259168548 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "POST /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6/action" status: 202 len: 0 microversion: 2.1 time: 0.839436 Jun 23 13:43:34.807783 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 263/541] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Jun 23 13:43:33 2022] POST /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6/action => generated 0 bytes in 841 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 13:43:34.816156 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-a926b146-e0f4-471d-83ae-769eca05c383 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:34.817000 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-a926b146-e0f4-471d-83ae-769eca05c383 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: 7fb7c75c-c825-43e8-a4f0-43b5e62331a9] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:34.828066 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a926b146-e0f4-471d-83ae-769eca05c383 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:34.828370 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a926b146-e0f4-471d-83ae-769eca05c383 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:34.829232 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a926b146-e0f4-471d-83ae-769eca05c383 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:34.829776 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a926b146-e0f4-471d-83ae-769eca05c383 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:34.996743 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-bb75c742-457b-4187-a334-da025e94f577 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:35.009500 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-bb75c742-457b-4187-a334-da025e94f577 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1735 microversion: 2.1 time: 0.257886 Jun 23 13:43:35.010320 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 279/542] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:34 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1735 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:35.017229 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-b7aa7339-b5f2-4e4b-bc9a-9f372b4cf19d tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:35.018060 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-b7aa7339-b5f2-4e4b-bc9a-9f372b4cf19d tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:35.022534 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-a926b146-e0f4-471d-83ae-769eca05c383 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:35.024508 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b7aa7339-b5f2-4e4b-bc9a-9f372b4cf19d tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:35.024957 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b7aa7339-b5f2-4e4b-bc9a-9f372b4cf19d tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:35.025722 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b7aa7339-b5f2-4e4b-bc9a-9f372b4cf19d tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:35.026145 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b7aa7339-b5f2-4e4b-bc9a-9f372b4cf19d tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:35.033011 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-a926b146-e0f4-471d-83ae-769eca05c383 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9" status: 200 len: 1319 microversion: 2.1 time: 0.220401 Jun 23 13:43:35.034340 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 264/543] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:34 2022] GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:35.039146 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-cf6e6c46-1d06-400f-97f7-caef9a9ab580 req-c6d6fe82-5f5c-4e6d-986d-2689152ad5df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01f7b0a9-1671-460d-8a52-541dc119c6f6", "tag": "f801c0fd-febc-4835-97ee-811b19175e3e"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:43:35.047652 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-cf6e6c46-1d06-400f-97f7-caef9a9ab580 req-c6d6fe82-5f5c-4e6d-986d-2689152ad5df service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:35.048324 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-cf6e6c46-1d06-400f-97f7-caef9a9ab580 req-c6d6fe82-5f5c-4e6d-986d-2689152ad5df service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:35.060620 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-cf6e6c46-1d06-400f-97f7-caef9a9ab580 req-c6d6fe82-5f5c-4e6d-986d-2689152ad5df service nova] Creating event network-changed:f801c0fd-febc-4835-97ee-811b19175e3e for instance 01f7b0a9-1671-460d-8a52-541dc119c6f6 on hv-cinder-81558 Jun 23 13:43:35.066158 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-cf6e6c46-1d06-400f-97f7-caef9a9ab580 req-c6d6fe82-5f5c-4e6d-986d-2689152ad5df service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030428 Jun 23 13:43:35.066695 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 265/544] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:43:35.181238 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-b7aa7339-b5f2-4e4b-bc9a-9f372b4cf19d tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:35.189760 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-b7aa7339-b5f2-4e4b-bc9a-9f372b4cf19d tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1756 microversion: 2.1 time: 0.177554 Jun 23 13:43:35.190386 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 280/545] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:35 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:35.773186 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-0aad2f5b-89a3-44b8-8088-de0cb9774b9b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:35.774363 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-0aad2f5b-89a3-44b8-8088-de0cb9774b9b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:35.784381 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0aad2f5b-89a3-44b8-8088-de0cb9774b9b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:35.784828 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0aad2f5b-89a3-44b8-8088-de0cb9774b9b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:35.785577 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0aad2f5b-89a3-44b8-8088-de0cb9774b9b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:35.786021 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0aad2f5b-89a3-44b8-8088-de0cb9774b9b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:35.920285 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-0aad2f5b-89a3-44b8-8088-de0cb9774b9b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:35.931676 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-0aad2f5b-89a3-44b8-8088-de0cb9774b9b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528" status: 200 len: 1368 microversion: 2.1 time: 0.165206 Jun 23 13:43:35.932418 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 266/546] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:35 2022] GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:36.031300 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-47a7c549-0220-438a-8672-57c88819bb28 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:36.032333 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-47a7c549-0220-438a-8672-57c88819bb28 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:36.043168 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-47a7c549-0220-438a-8672-57c88819bb28 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:36.043958 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-47a7c549-0220-438a-8672-57c88819bb28 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:36.045258 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-47a7c549-0220-438a-8672-57c88819bb28 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:36.046127 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-47a7c549-0220-438a-8672-57c88819bb28 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:36.051571 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c1213ddd-d92b-4f94-a63b-3b17b3571acb tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:36.052280 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-c1213ddd-d92b-4f94-a63b-3b17b3571acb tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: 7fb7c75c-c825-43e8-a4f0-43b5e62331a9] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:36.058690 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c1213ddd-d92b-4f94-a63b-3b17b3571acb tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:36.059137 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c1213ddd-d92b-4f94-a63b-3b17b3571acb tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:36.059924 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c1213ddd-d92b-4f94-a63b-3b17b3571acb tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:36.060356 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c1213ddd-d92b-4f94-a63b-3b17b3571acb tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:36.248210 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-47a7c549-0220-438a-8672-57c88819bb28 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:36.253974 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-c1213ddd-d92b-4f94-a63b-3b17b3571acb tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:36.257498 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-47a7c549-0220-438a-8672-57c88819bb28 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1735 microversion: 2.1 time: 0.232449 Jun 23 13:43:36.258063 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 281/547] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:36 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1735 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:36.261608 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-c1213ddd-d92b-4f94-a63b-3b17b3571acb tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9" status: 200 len: 1506 microversion: 2.1 time: 0.214253 Jun 23 13:43:36.262195 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 267/548] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:36 2022] GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9 => generated 1506 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:36.280516 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-5a4f4a3b-e2a0-42f8-81fa-febcd4015f2b tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86268fbe-0e6b-4245-8039-35980b2a8878", "device": "/dev/sdb"}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:43:36.282842 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-5a4f4a3b-e2a0-42f8-81fa-febcd4015f2b tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: 7fb7c75c-c825-43e8-a4f0-43b5e62331a9] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:36.285559 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:43:36.292306 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5a4f4a3b-e2a0-42f8-81fa-febcd4015f2b tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:36.292872 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5a4f4a3b-e2a0-42f8-81fa-febcd4015f2b tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:36.293988 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5a4f4a3b-e2a0-42f8-81fa-febcd4015f2b tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:36.294601 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5a4f4a3b-e2a0-42f8-81fa-febcd4015f2b tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:36.950166 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-29444fa5-343f-4c80-b7c2-ce1557eb8899 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:36.951231 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-29444fa5-343f-4c80-b7c2-ce1557eb8899 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:36.960082 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-29444fa5-343f-4c80-b7c2-ce1557eb8899 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:36.960859 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-29444fa5-343f-4c80-b7c2-ce1557eb8899 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:36.962067 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-29444fa5-343f-4c80-b7c2-ce1557eb8899 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:36.963299 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-29444fa5-343f-4c80-b7c2-ce1557eb8899 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:37.102119 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-29444fa5-343f-4c80-b7c2-ce1557eb8899 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:37.109872 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-29444fa5-343f-4c80-b7c2-ce1557eb8899 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528" status: 200 len: 1368 microversion: 2.1 time: 0.164482 Jun 23 13:43:37.111065 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 268/549] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:36 2022] GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:37.121599 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-5a4f4a3b-e2a0-42f8-81fa-febcd4015f2b tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "POST /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.847087 Jun 23 13:43:37.122711 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 282/550] 10.222.0.26 () {60 vars in 1322 bytes} [Thu Jun 23 13:43:36 2022] POST /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9/os-volume_attachments => generated 194 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:43:37.275325 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-557a4bf1-0eae-4788-bdec-b63872e55c13 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:37.275936 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-557a4bf1-0eae-4788-bdec-b63872e55c13 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:37.282396 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-557a4bf1-0eae-4788-bdec-b63872e55c13 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:37.282913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-557a4bf1-0eae-4788-bdec-b63872e55c13 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:37.283732 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-557a4bf1-0eae-4788-bdec-b63872e55c13 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:37.284164 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-557a4bf1-0eae-4788-bdec-b63872e55c13 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:37.427246 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-557a4bf1-0eae-4788-bdec-b63872e55c13 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:37.436153 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-557a4bf1-0eae-4788-bdec-b63872e55c13 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1735 microversion: 2.1 time: 0.164727 Jun 23 13:43:37.436748 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 269/551] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:37 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:38.129003 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-8543d881-b345-4950-9eea-2cf7a193733a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:38.129744 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-8543d881-b345-4950-9eea-2cf7a193733a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:38.136476 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8543d881-b345-4950-9eea-2cf7a193733a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:38.136921 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8543d881-b345-4950-9eea-2cf7a193733a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:38.137669 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8543d881-b345-4950-9eea-2cf7a193733a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:38.138100 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8543d881-b345-4950-9eea-2cf7a193733a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:38.280707 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-8543d881-b345-4950-9eea-2cf7a193733a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:38.288156 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-8543d881-b345-4950-9eea-2cf7a193733a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528" status: 200 len: 1368 microversion: 2.1 time: 0.165146 Jun 23 13:43:38.288698 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 283/552] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:38 2022] GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:38.454989 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-71a572c5-f6d1-4bc7-aff5-b26bb64db32d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:38.455638 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-71a572c5-f6d1-4bc7-aff5-b26bb64db32d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:38.462991 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-71a572c5-f6d1-4bc7-aff5-b26bb64db32d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:38.463418 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-71a572c5-f6d1-4bc7-aff5-b26bb64db32d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:38.464188 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-71a572c5-f6d1-4bc7-aff5-b26bb64db32d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:38.464620 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-71a572c5-f6d1-4bc7-aff5-b26bb64db32d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:38.599799 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-71a572c5-f6d1-4bc7-aff5-b26bb64db32d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:38.607816 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-71a572c5-f6d1-4bc7-aff5-b26bb64db32d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1735 microversion: 2.1 time: 0.157560 Jun 23 13:43:38.608384 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 270/553] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:38 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:39.305175 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-c916ebf1-73e8-4b95-896f-5182a1ddba2c tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:39.305790 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-c916ebf1-73e8-4b95-896f-5182a1ddba2c tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:39.312679 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c916ebf1-73e8-4b95-896f-5182a1ddba2c tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:39.313127 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c916ebf1-73e8-4b95-896f-5182a1ddba2c tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:39.313898 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c916ebf1-73e8-4b95-896f-5182a1ddba2c tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:39.314336 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c916ebf1-73e8-4b95-896f-5182a1ddba2c tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:39.455063 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-c916ebf1-73e8-4b95-896f-5182a1ddba2c tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:39.465882 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-c916ebf1-73e8-4b95-896f-5182a1ddba2c tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528" status: 200 len: 1368 microversion: 2.1 time: 0.164312 Jun 23 13:43:39.466645 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 284/554] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:39 2022] GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:39.629320 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-fdbea4be-8fa6-4bbc-b87f-b5747f28d9ec tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:39.630318 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-fdbea4be-8fa6-4bbc-b87f-b5747f28d9ec tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:39.641227 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fdbea4be-8fa6-4bbc-b87f-b5747f28d9ec tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:39.642020 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fdbea4be-8fa6-4bbc-b87f-b5747f28d9ec tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:39.643259 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fdbea4be-8fa6-4bbc-b87f-b5747f28d9ec tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:39.644032 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fdbea4be-8fa6-4bbc-b87f-b5747f28d9ec tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:39.719599 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell0:SELECT=8 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:43:39.778557 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-fdbea4be-8fa6-4bbc-b87f-b5747f28d9ec tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:39.786959 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-fdbea4be-8fa6-4bbc-b87f-b5747f28d9ec tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1735 microversion: 2.1 time: 0.164170 Jun 23 13:43:39.787565 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 271/555] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:39 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:40.459095 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-caf0dbc6-b6fa-4be5-a737-ffcaa51c08ea req-b88c95ab-3961-4f7c-a2bf-f41c5cdedd63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d2cbd7f-a2a8-4a8e-beea-655a691d1528", "name": "network-vif-plugged", "status": "completed", "tag": "11905686-c708-4716-8310-c8bbd7705aa0"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:43:40.464529 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell0:SELECT=6 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:43:40.465257 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell0:SELECT=12 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:43:40.470734 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-caf0dbc6-b6fa-4be5-a737-ffcaa51c08ea req-b88c95ab-3961-4f7c-a2bf-f41c5cdedd63 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:40.471220 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-caf0dbc6-b6fa-4be5-a737-ffcaa51c08ea req-b88c95ab-3961-4f7c-a2bf-f41c5cdedd63 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:40.476060 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:43:40.484491 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-caf0dbc6-b6fa-4be5-a737-ffcaa51c08ea req-b88c95ab-3961-4f7c-a2bf-f41c5cdedd63 service nova] Creating event network-vif-plugged:11905686-c708-4716-8310-c8bbd7705aa0 for instance 2d2cbd7f-a2a8-4a8e-beea-655a691d1528 on hv-cinder-81558 Jun 23 13:43:40.484967 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-13a76ad3-fa81-4933-92bd-09a6153d359b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:40.485640 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-13a76ad3-fa81-4933-92bd-09a6153d359b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:40.490379 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-caf0dbc6-b6fa-4be5-a737-ffcaa51c08ea req-b88c95ab-3961-4f7c-a2bf-f41c5cdedd63 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035331 Jun 23 13:43:40.491391 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 285/556] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:43:40.493075 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-13a76ad3-fa81-4933-92bd-09a6153d359b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:40.493518 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-13a76ad3-fa81-4933-92bd-09a6153d359b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:40.494313 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-13a76ad3-fa81-4933-92bd-09a6153d359b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:40.494725 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-13a76ad3-fa81-4933-92bd-09a6153d359b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:40.625194 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-13a76ad3-fa81-4933-92bd-09a6153d359b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:40.632749 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-13a76ad3-fa81-4933-92bd-09a6153d359b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528" status: 200 len: 1368 microversion: 2.1 time: 0.152383 Jun 23 13:43:40.633353 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 272/557] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:40 2022] GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:40.805968 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-1ce7e1c9-10c1-49f4-a04e-d83cdbb81a9c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:40.806753 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-1ce7e1c9-10c1-49f4-a04e-d83cdbb81a9c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:40.813972 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1ce7e1c9-10c1-49f4-a04e-d83cdbb81a9c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:40.814519 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1ce7e1c9-10c1-49f4-a04e-d83cdbb81a9c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:40.815358 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1ce7e1c9-10c1-49f4-a04e-d83cdbb81a9c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:40.815888 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1ce7e1c9-10c1-49f4-a04e-d83cdbb81a9c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:40.949349 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-1ce7e1c9-10c1-49f4-a04e-d83cdbb81a9c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:40.961463 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-1ce7e1c9-10c1-49f4-a04e-d83cdbb81a9c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1735 microversion: 2.1 time: 0.160365 Jun 23 13:43:40.962136 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 286/558] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:40 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:41.653723 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-3afc193a-997e-4f1b-9b84-148495bb26ee tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:41.654718 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-3afc193a-997e-4f1b-9b84-148495bb26ee tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:41.662545 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3afc193a-997e-4f1b-9b84-148495bb26ee tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:41.663028 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3afc193a-997e-4f1b-9b84-148495bb26ee tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:41.663820 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3afc193a-997e-4f1b-9b84-148495bb26ee tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:41.664253 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3afc193a-997e-4f1b-9b84-148495bb26ee tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:41.668226 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:SELECT=100 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:43:41.801682 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-3afc193a-997e-4f1b-9b84-148495bb26ee tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:41.809930 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-3afc193a-997e-4f1b-9b84-148495bb26ee tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528" status: 200 len: 1368 microversion: 2.1 time: 0.162694 Jun 23 13:43:41.810606 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 273/559] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:41 2022] GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:41.983830 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-382a2b13-db11-4e83-9157-2a6fbe1ee953 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:41.984502 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-382a2b13-db11-4e83-9157-2a6fbe1ee953 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:41.993073 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-382a2b13-db11-4e83-9157-2a6fbe1ee953 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:41.993627 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-382a2b13-db11-4e83-9157-2a6fbe1ee953 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:41.994563 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-382a2b13-db11-4e83-9157-2a6fbe1ee953 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:41.995098 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-382a2b13-db11-4e83-9157-2a6fbe1ee953 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:42.123847 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-382a2b13-db11-4e83-9157-2a6fbe1ee953 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:42.132348 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-382a2b13-db11-4e83-9157-2a6fbe1ee953 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1715 microversion: 2.1 time: 0.153578 Jun 23 13:43:42.132922 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 287/560] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:41 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1715 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:42.240912 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-7e561117-b916-471a-a79d-e0b63d307577 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:42.241348 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-7e561117-b916-471a-a79d-e0b63d307577 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:42.247506 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7e561117-b916-471a-a79d-e0b63d307577 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:42.247964 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7e561117-b916-471a-a79d-e0b63d307577 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:42.248721 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7e561117-b916-471a-a79d-e0b63d307577 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:42.249194 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7e561117-b916-471a-a79d-e0b63d307577 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:42.342968 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.wsgi [None req-7e561117-b916-471a-a79d-e0b63d307577 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] HTTP exception thrown: Cannot 'detach_volume' instance d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb while it is in vm_state rescued Jun 23 13:43:42.344649 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-7e561117-b916-471a-a79d-e0b63d307577 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Request method failure captured: Jun 23 13:43:42.344649 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: request: DELETE /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb/os-volume_attachments/e72ae7a9-bc98-4260-9abb-fd01871f19dc HTTP/1.1 Jun 23 13:43:42.344649 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept: application/json Jun 23 13:43:42.344649 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept-Encoding: identity Jun 23 13:43:42.344649 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Connection: close Jun 23 13:43:42.344649 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Length: 0 Jun 23 13:43:42.344649 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Type: application/json Jun 23 13:43:42.344649 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Host: 10.222.0.26 Jun 23 13:43:42.344649 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Openstack-System-Scope: None Jun 23 13:43:42.344649 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: User-Agent: python-urllib3/1.26.9 Jun 23 13:43:42.344649 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Auth-Token: gAAAAABitG0Sk3ITYqPOix6d-yn0tfx-OSIDvIuV7UJjc74SbWZgVnKUDm8nfkPPw_HDdmKI8sNR-ZRrPiM2VFS2aGUijneFicZmaRheJVdwbvopsixSQO0yPOZxFVs3fvoZ2ibh1WvoqBrlfRHbN7g-Iz0o0UFhet-npHvAovII03AWNWb9zgg Jun 23 13:43:42.344649 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Id: None Jun 23 13:43:42.344649 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Name: None Jun 23 13:43:42.344649 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Identity-Status: Confirmed Jun 23 13:43:42.344649 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Is-Admin-Project: True Jun 23 13:43:42.344649 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Id: default Jun 23 13:43:42.344649 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Name: Default Jun 23 13:43:42.344649 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Id: 855cb6e79485414ab0f2a40162231d72 Jun 23 13:43:42.344649 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-140294951 Jun 23 13:43:42.344649 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Role: member,reader Jun 23 13:43:42.344649 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Roles: member,reader Jun 23 13:43:42.346107 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/855cb6e79485414ab0f2a40162231d72"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/855cb6e79485414ab0f2a40162231d72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/855cb6e79485414ab0f2a40162231d72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_855cb6e79485414ab0f2a40162231d72", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:43:42.346107 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant: tempest-ServerRescueNegativeTestJSON-140294951 Jun 23 13:43:42.346107 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Id: 855cb6e79485414ab0f2a40162231d72 Jun 23 13:43:42.346107 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-140294951 Jun 23 13:43:42.346107 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User: tempest-ServerRescueNegativeTestJSON-140294951-project Jun 23 13:43:42.346107 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Id: default Jun 23 13:43:42.346107 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Name: Default Jun 23 13:43:42.346107 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Id: ae510389cfc04a0cb4e6991df2a93a00 Jun 23 13:43:42.346107 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Name: tempest-ServerRescueNegativeTestJSON-140294951-project Jun 23 13:43:42.346107 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: method: > Jun 23 13:43:42.346107 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: exception: Cannot 'detach_volume' instance d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb while it is in vm_state rescued Jun 23 13:43:42.346885 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: action_args: {'server_id': 'd93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb', 'id': 'e72ae7a9-bc98-4260-9abb-fd01871f19dc'} Jun 23 13:43:42.346885 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:43:42.346885 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:43:42.346885 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 23 13:43:42.346885 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 23 13:43:42.346885 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 13:43:42.346885 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 13:43:42.346885 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 23 13:43:42.346885 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 23 13:43:42.346885 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 23 13:43:42.346885 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:43:42.346885 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:43:42.346885 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:43:42.346885 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:43:42.346885 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:43:42.346885 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:43:42.346885 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:43:42.346885 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:43:42.346885 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:43:42.346885 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:43:42.348380 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 23 13:43:42.348380 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 23 13:43:42.348380 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 23 13:43:42.348380 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 23 13:43:42.348380 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb while it is in vm_state rescued Jun 23 13:43:42.348380 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:43:42.348380 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:43:42.348380 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:43:42.348380 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:43:42.348380 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:43:42.348380 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:43:42.348380 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:43:42.348380 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:43:42.348380 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb while it is in vm_state rescued Jun 23 13:43:42.348380 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:43:42.348380 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-7e561117-b916-471a-a79d-e0b63d307577 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Returning 409 to user: Cannot 'detach_volume' instance d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb while it is in vm_state rescued {{(pid=134666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:43:42.349521 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-7e561117-b916-471a-a79d-e0b63d307577 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb/os-volume_attachments/e72ae7a9-bc98-4260-9abb-fd01871f19dc" status: 409 len: 152 microversion: 2.1 time: 0.109370 Jun 23 13:43:42.349521 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 274/561] 10.222.0.26 () {58 vars in 1415 bytes} [Thu Jun 23 13:43:42 2022] DELETE /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb/os-volume_attachments/e72ae7a9-bc98-4260-9abb-fd01871f19dc => generated 152 bytes in 110 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 23 13:43:42.355032 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-32830d1a-84bd-4523-a4e5-88ee6eb123ae tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:43:42.355602 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-32830d1a-84bd-4523-a4e5-88ee6eb123ae tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:42.362055 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-32830d1a-84bd-4523-a4e5-88ee6eb123ae tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:42.362518 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-32830d1a-84bd-4523-a4e5-88ee6eb123ae tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:42.363300 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-32830d1a-84bd-4523-a4e5-88ee6eb123ae tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:42.363750 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-32830d1a-84bd-4523-a4e5-88ee6eb123ae tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:42.437177 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-32830d1a-84bd-4523-a4e5-88ee6eb123ae tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "POST /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb/action" status: 202 len: 0 microversion: 2.1 time: 0.085387 Jun 23 13:43:42.440605 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 288/562] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Jun 23 13:43:42 2022] POST /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 13:43:42.449546 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-40032ab2-ce27-4cf4-9bfd-1e9a75c5501d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:42.450225 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-40032ab2-ce27-4cf4-9bfd-1e9a75c5501d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:42.460527 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-40032ab2-ce27-4cf4-9bfd-1e9a75c5501d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:42.461112 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-40032ab2-ce27-4cf4-9bfd-1e9a75c5501d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:42.461915 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-40032ab2-ce27-4cf4-9bfd-1e9a75c5501d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:42.462357 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-40032ab2-ce27-4cf4-9bfd-1e9a75c5501d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:42.597775 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-40032ab2-ce27-4cf4-9bfd-1e9a75c5501d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:42.605852 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-40032ab2-ce27-4cf4-9bfd-1e9a75c5501d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1723 microversion: 2.1 time: 0.164159 Jun 23 13:43:42.606416 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 275/563] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:42 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:42.831067 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-9c2b71af-3115-4095-858e-c9d5533d4062 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:42.831816 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-9c2b71af-3115-4095-858e-c9d5533d4062 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:42.839876 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9c2b71af-3115-4095-858e-c9d5533d4062 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:42.840397 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9c2b71af-3115-4095-858e-c9d5533d4062 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:42.841285 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9c2b71af-3115-4095-858e-c9d5533d4062 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:42.842197 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9c2b71af-3115-4095-858e-c9d5533d4062 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:42.983853 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-9c2b71af-3115-4095-858e-c9d5533d4062 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:42.991716 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-9c2b71af-3115-4095-858e-c9d5533d4062 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528" status: 200 len: 1368 microversion: 2.1 time: 0.167843 Jun 23 13:43:42.992273 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 289/564] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:42 2022] GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:43.508192 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-8f639e0e-e612-467f-98d5-4ea9fc5ec074 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:43.508934 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-8f639e0e-e612-467f-98d5-4ea9fc5ec074 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:43.517267 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8f639e0e-e612-467f-98d5-4ea9fc5ec074 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:43.517715 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8f639e0e-e612-467f-98d5-4ea9fc5ec074 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:43.518466 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8f639e0e-e612-467f-98d5-4ea9fc5ec074 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:43.518895 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8f639e0e-e612-467f-98d5-4ea9fc5ec074 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:43.547637 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-8f639e0e-e612-467f-98d5-4ea9fc5ec074 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/os-volume_attachments/c0d3e79e-9047-45a0-b782-5fa4010f5a78" status: 200 len: 194 microversion: 2.20 time: 0.044904 Jun 23 13:43:43.548219 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 276/565] 10.222.0.26 () {60 vars in 1453 bytes} [Thu Jun 23 13:43:43 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/os-volume_attachments/c0d3e79e-9047-45a0-b782-5fa4010f5a78 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 13:43:43.619589 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-21c3570b-10a2-4c83-9d5e-e44165e692e2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:43.620117 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-21c3570b-10a2-4c83-9d5e-e44165e692e2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:43.623089 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-059f03e9-6d4b-465c-bdb2-ecbf13b01317 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:43.623748 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-059f03e9-6d4b-465c-bdb2-ecbf13b01317 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:43.626388 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-21c3570b-10a2-4c83-9d5e-e44165e692e2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:43.626888 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-21c3570b-10a2-4c83-9d5e-e44165e692e2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:43.627707 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-21c3570b-10a2-4c83-9d5e-e44165e692e2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:43.628141 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-21c3570b-10a2-4c83-9d5e-e44165e692e2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:43.630088 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-059f03e9-6d4b-465c-bdb2-ecbf13b01317 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:43.630553 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-059f03e9-6d4b-465c-bdb2-ecbf13b01317 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:43.631305 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-059f03e9-6d4b-465c-bdb2-ecbf13b01317 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:43.631767 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-059f03e9-6d4b-465c-bdb2-ecbf13b01317 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:43.753853 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.objects.instance [None req-21c3570b-10a2-4c83-9d5e-e44165e692e2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lazy-loading 'services' on Instance uuid b9ddb941-db20-4a0c-b841-d99368ad4f21 {{(pid=134667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:43:43.764854 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-059f03e9-6d4b-465c-bdb2-ecbf13b01317 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:43.773159 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-059f03e9-6d4b-465c-bdb2-ecbf13b01317 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1723 microversion: 2.1 time: 0.153860 Jun 23 13:43:43.773718 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 277/566] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:43 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:43.871282 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-21c3570b-10a2-4c83-9d5e-e44165e692e2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/os-volume_attachments/c0d3e79e-9047-45a0-b782-5fa4010f5a78" status: 202 len: 0 microversion: 2.20 time: 0.255599 Jun 23 13:43:43.871930 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 290/567] 10.222.0.26 () {60 vars in 1456 bytes} [Thu Jun 23 13:43:43 2022] DELETE /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/os-volume_attachments/c0d3e79e-9047-45a0-b782-5fa4010f5a78 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 13:43:43.881129 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-3cca39ce-a7bc-469c-a6a1-79f1fcd5b4bf tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:43.882614 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-3cca39ce-a7bc-469c-a6a1-79f1fcd5b4bf tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:43.884077 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:43:43.890271 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3cca39ce-a7bc-469c-a6a1-79f1fcd5b4bf tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:43.890748 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3cca39ce-a7bc-469c-a6a1-79f1fcd5b4bf tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:43.891602 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3cca39ce-a7bc-469c-a6a1-79f1fcd5b4bf tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:43.892036 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3cca39ce-a7bc-469c-a6a1-79f1fcd5b4bf tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:43.929416 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-3cca39ce-a7bc-469c-a6a1-79f1fcd5b4bf tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053018 Jun 23 13:43:43.929993 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 278/568] 10.222.0.26 () {60 vars in 1342 bytes} [Thu Jun 23 13:43:43 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 13:43:44.009428 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-bf45a6e6-5fed-4736-8e84-9d5b4d052ea0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:44.010739 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-bf45a6e6-5fed-4736-8e84-9d5b4d052ea0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:44.017856 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bf45a6e6-5fed-4736-8e84-9d5b4d052ea0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:44.018365 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bf45a6e6-5fed-4736-8e84-9d5b4d052ea0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:44.019417 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bf45a6e6-5fed-4736-8e84-9d5b4d052ea0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:44.020100 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bf45a6e6-5fed-4736-8e84-9d5b4d052ea0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:44.154527 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-bf45a6e6-5fed-4736-8e84-9d5b4d052ea0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:44.162667 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-bf45a6e6-5fed-4736-8e84-9d5b4d052ea0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528" status: 200 len: 1368 microversion: 2.1 time: 0.157725 Jun 23 13:43:44.163198 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 291/569] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:44 2022] GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:44.794035 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-79a1ef4e-a0db-46b8-8852-7c463ee837f4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:44.796016 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-79a1ef4e-a0db-46b8-8852-7c463ee837f4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:44.807156 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-79a1ef4e-a0db-46b8-8852-7c463ee837f4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:44.807985 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-79a1ef4e-a0db-46b8-8852-7c463ee837f4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:44.809346 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-79a1ef4e-a0db-46b8-8852-7c463ee837f4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:44.810005 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-79a1ef4e-a0db-46b8-8852-7c463ee837f4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:44.939905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-79a1ef4e-a0db-46b8-8852-7c463ee837f4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:44.941454 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-1c881f1f-6a31-44be-8f2f-55172837b87f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:44.942499 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-1c881f1f-6a31-44be-8f2f-55172837b87f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:44.948368 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-79a1ef4e-a0db-46b8-8852-7c463ee837f4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1723 microversion: 2.1 time: 0.160660 Jun 23 13:43:44.948674 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1c881f1f-6a31-44be-8f2f-55172837b87f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:44.949123 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 279/570] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:44 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:44.949232 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1c881f1f-6a31-44be-8f2f-55172837b87f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:44.950274 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1c881f1f-6a31-44be-8f2f-55172837b87f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:44.950719 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1c881f1f-6a31-44be-8f2f-55172837b87f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:44.980980 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-1c881f1f-6a31-44be-8f2f-55172837b87f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043531 Jun 23 13:43:44.981547 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 292/571] 10.222.0.26 () {60 vars in 1342 bytes} [Thu Jun 23 13:43:44 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 13:43:45.183822 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-f66ceaf1-9c77-45e4-ba3a-5b0bd44a12cb tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:45.184815 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-f66ceaf1-9c77-45e4-ba3a-5b0bd44a12cb tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:45.194956 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f66ceaf1-9c77-45e4-ba3a-5b0bd44a12cb tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:45.195792 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f66ceaf1-9c77-45e4-ba3a-5b0bd44a12cb tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:45.197007 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f66ceaf1-9c77-45e4-ba3a-5b0bd44a12cb tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:45.197719 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f66ceaf1-9c77-45e4-ba3a-5b0bd44a12cb tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:45.339266 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-f66ceaf1-9c77-45e4-ba3a-5b0bd44a12cb tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:45.347108 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-f66ceaf1-9c77-45e4-ba3a-5b0bd44a12cb tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528" status: 200 len: 1368 microversion: 2.1 time: 0.169904 Jun 23 13:43:45.347718 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 280/572] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:45 2022] GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:45.968204 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-bbdf2ec3-c583-44df-a684-165c96f5147c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:45.969037 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-bbdf2ec3-c583-44df-a684-165c96f5147c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:45.977660 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bbdf2ec3-c583-44df-a684-165c96f5147c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:45.978254 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bbdf2ec3-c583-44df-a684-165c96f5147c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:45.979250 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bbdf2ec3-c583-44df-a684-165c96f5147c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:45.979867 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bbdf2ec3-c583-44df-a684-165c96f5147c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:45.993040 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-1f401d38-35fe-4ec0-9dbb-e4886890b6e5 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:45.993961 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-1f401d38-35fe-4ec0-9dbb-e4886890b6e5 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:46.000832 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1f401d38-35fe-4ec0-9dbb-e4886890b6e5 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:46.001267 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1f401d38-35fe-4ec0-9dbb-e4886890b6e5 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:46.002026 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1f401d38-35fe-4ec0-9dbb-e4886890b6e5 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:46.002456 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1f401d38-35fe-4ec0-9dbb-e4886890b6e5 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:46.032661 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-1f401d38-35fe-4ec0-9dbb-e4886890b6e5 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043678 Jun 23 13:43:46.033492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 281/573] 10.222.0.26 () {60 vars in 1342 bytes} [Thu Jun 23 13:43:45 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 13:43:46.114128 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-bbdf2ec3-c583-44df-a684-165c96f5147c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:46.126517 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-bbdf2ec3-c583-44df-a684-165c96f5147c tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1723 microversion: 2.1 time: 0.163375 Jun 23 13:43:46.127086 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 293/574] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:45 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:46.365929 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-df87aed7-59c5-4452-a9d3-5611c0115962 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:46.366685 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-df87aed7-59c5-4452-a9d3-5611c0115962 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:46.374561 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-df87aed7-59c5-4452-a9d3-5611c0115962 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:46.375125 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-df87aed7-59c5-4452-a9d3-5611c0115962 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:46.376067 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-df87aed7-59c5-4452-a9d3-5611c0115962 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:46.376501 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-df87aed7-59c5-4452-a9d3-5611c0115962 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:46.509459 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-df87aed7-59c5-4452-a9d3-5611c0115962 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:46.517185 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-df87aed7-59c5-4452-a9d3-5611c0115962 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528" status: 200 len: 1558 microversion: 2.1 time: 0.156114 Jun 23 13:43:46.517750 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 282/575] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:46 2022] GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:46.533970 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-de2f26f9-074f-4b31-8eff-a967cdc8ee87 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:46.534455 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-de2f26f9-074f-4b31-8eff-a967cdc8ee87 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:46.540812 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-de2f26f9-074f-4b31-8eff-a967cdc8ee87 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:46.541256 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-de2f26f9-074f-4b31-8eff-a967cdc8ee87 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:46.542008 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-de2f26f9-074f-4b31-8eff-a967cdc8ee87 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:46.542441 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-de2f26f9-074f-4b31-8eff-a967cdc8ee87 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:46.627292 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-de2f26f9-074f-4b31-8eff-a967cdc8ee87 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097123 Jun 23 13:43:46.627928 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 294/576] 10.222.0.26 () {58 vars in 1274 bytes} [Thu Jun 23 13:43:46 2022] GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:43:47.044844 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-fc81599c-2a50-4d66-b223-700ae6f491d0 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:47.045934 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-fc81599c-2a50-4d66-b223-700ae6f491d0 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:47.052750 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fc81599c-2a50-4d66-b223-700ae6f491d0 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:47.053201 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fc81599c-2a50-4d66-b223-700ae6f491d0 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:47.053965 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fc81599c-2a50-4d66-b223-700ae6f491d0 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:47.054398 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fc81599c-2a50-4d66-b223-700ae6f491d0 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:47.084699 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-fc81599c-2a50-4d66-b223-700ae6f491d0 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043859 Jun 23 13:43:47.085264 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 283/577] 10.222.0.26 () {60 vars in 1342 bytes} [Thu Jun 23 13:43:47 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 13:43:47.149932 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-692b9368-042d-4aa7-a90a-a0c19fc8e968 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:47.150526 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-692b9368-042d-4aa7-a90a-a0c19fc8e968 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:47.158459 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-692b9368-042d-4aa7-a90a-a0c19fc8e968 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:47.158908 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-692b9368-042d-4aa7-a90a-a0c19fc8e968 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:47.159709 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-692b9368-042d-4aa7-a90a-a0c19fc8e968 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:47.160148 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-692b9368-042d-4aa7-a90a-a0c19fc8e968 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:47.368387 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-692b9368-042d-4aa7-a90a-a0c19fc8e968 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:47.376749 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-692b9368-042d-4aa7-a90a-a0c19fc8e968 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1723 microversion: 2.1 time: 0.232047 Jun 23 13:43:47.377317 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 295/578] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:47 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:47.611030 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-9a455fe6-4a33-41f8-8b92-d065cc890f54 req-291e7931-1724-432e-a9fb-b2f304764c32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d2cbd7f-a2a8-4a8e-beea-655a691d1528", "tag": "11905686-c708-4716-8310-c8bbd7705aa0"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:43:47.619305 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-9a455fe6-4a33-41f8-8b92-d065cc890f54 req-291e7931-1724-432e-a9fb-b2f304764c32 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:47.619716 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-9a455fe6-4a33-41f8-8b92-d065cc890f54 req-291e7931-1724-432e-a9fb-b2f304764c32 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:47.630983 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-9a455fe6-4a33-41f8-8b92-d065cc890f54 req-291e7931-1724-432e-a9fb-b2f304764c32 service nova] Creating event network-changed:11905686-c708-4716-8310-c8bbd7705aa0 for instance 2d2cbd7f-a2a8-4a8e-beea-655a691d1528 on hv-cinder-81558 Jun 23 13:43:47.636407 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-9a455fe6-4a33-41f8-8b92-d065cc890f54 req-291e7931-1724-432e-a9fb-b2f304764c32 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029135 Jun 23 13:43:47.637105 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 284/579] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:43:48.096566 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-7b3716c6-d74e-487a-a64c-e7a0960924fc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:48.097511 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-7b3716c6-d74e-487a-a64c-e7a0960924fc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:48.103869 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7b3716c6-d74e-487a-a64c-e7a0960924fc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:48.104342 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7b3716c6-d74e-487a-a64c-e7a0960924fc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:48.105123 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7b3716c6-d74e-487a-a64c-e7a0960924fc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:48.105556 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7b3716c6-d74e-487a-a64c-e7a0960924fc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:48.134601 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-7b3716c6-d74e-487a-a64c-e7a0960924fc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041915 Jun 23 13:43:48.135394 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 296/580] 10.222.0.26 () {60 vars in 1342 bytes} [Thu Jun 23 13:43:48 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 13:43:48.395177 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c855d211-8ee7-4633-ab6d-1ef52a1adb13 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:48.395913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-c855d211-8ee7-4633-ab6d-1ef52a1adb13 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:48.402411 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c855d211-8ee7-4633-ab6d-1ef52a1adb13 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:48.402865 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c855d211-8ee7-4633-ab6d-1ef52a1adb13 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:48.403694 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c855d211-8ee7-4633-ab6d-1ef52a1adb13 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:48.404148 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c855d211-8ee7-4633-ab6d-1ef52a1adb13 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:48.535680 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-c855d211-8ee7-4633-ab6d-1ef52a1adb13 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:48.544149 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-c855d211-8ee7-4633-ab6d-1ef52a1adb13 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1723 microversion: 2.1 time: 0.154111 Jun 23 13:43:48.544743 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 285/581] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:48 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:49.146420 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-33e39ff8-b45a-4850-a353-8dbc76c797d2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:49.148051 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-33e39ff8-b45a-4850-a353-8dbc76c797d2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:49.155456 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-33e39ff8-b45a-4850-a353-8dbc76c797d2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:49.156339 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-33e39ff8-b45a-4850-a353-8dbc76c797d2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:49.157485 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-33e39ff8-b45a-4850-a353-8dbc76c797d2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:49.157978 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-33e39ff8-b45a-4850-a353-8dbc76c797d2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:49.190198 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-33e39ff8-b45a-4850-a353-8dbc76c797d2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047933 Jun 23 13:43:49.190834 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 297/582] 10.222.0.26 () {60 vars in 1342 bytes} [Thu Jun 23 13:43:49 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 13:43:49.561078 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-3d8cdd85-a8a4-4fd9-b642-5bd3cd7462b2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:49.561696 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-3d8cdd85-a8a4-4fd9-b642-5bd3cd7462b2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:49.568703 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3d8cdd85-a8a4-4fd9-b642-5bd3cd7462b2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:49.569158 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3d8cdd85-a8a4-4fd9-b642-5bd3cd7462b2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:49.569927 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3d8cdd85-a8a4-4fd9-b642-5bd3cd7462b2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:49.570368 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3d8cdd85-a8a4-4fd9-b642-5bd3cd7462b2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:49.710231 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-3d8cdd85-a8a4-4fd9-b642-5bd3cd7462b2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:49.718278 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-3d8cdd85-a8a4-4fd9-b642-5bd3cd7462b2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1723 microversion: 2.1 time: 0.161190 Jun 23 13:43:49.718863 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 286/583] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:49 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:50.201848 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-788efa93-ecad-4389-88f5-78a26f3d0763 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:50.202704 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-788efa93-ecad-4389-88f5-78a26f3d0763 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:50.209764 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-788efa93-ecad-4389-88f5-78a26f3d0763 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:50.210207 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-788efa93-ecad-4389-88f5-78a26f3d0763 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:50.210947 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-788efa93-ecad-4389-88f5-78a26f3d0763 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:50.211371 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-788efa93-ecad-4389-88f5-78a26f3d0763 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:50.239919 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-788efa93-ecad-4389-88f5-78a26f3d0763 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042170 Jun 23 13:43:50.240464 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 298/584] 10.222.0.26 () {60 vars in 1342 bytes} [Thu Jun 23 13:43:50 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 13:43:50.739012 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-1ebf6804-9139-45d0-9125-151deb8d8975 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:50.740075 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-1ebf6804-9139-45d0-9125-151deb8d8975 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:50.750860 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1ebf6804-9139-45d0-9125-151deb8d8975 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:50.751301 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1ebf6804-9139-45d0-9125-151deb8d8975 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:50.752092 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1ebf6804-9139-45d0-9125-151deb8d8975 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:50.752526 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1ebf6804-9139-45d0-9125-151deb8d8975 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:50.889433 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-1ebf6804-9139-45d0-9125-151deb8d8975 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:50.897494 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-1ebf6804-9139-45d0-9125-151deb8d8975 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1723 microversion: 2.1 time: 0.164845 Jun 23 13:43:50.898061 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 287/585] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:50 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:51.255119 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-12ac2c63-416f-43b6-831e-70b074734915 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:51.256787 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-12ac2c63-416f-43b6-831e-70b074734915 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:51.267144 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-12ac2c63-416f-43b6-831e-70b074734915 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:51.267629 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-12ac2c63-416f-43b6-831e-70b074734915 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:51.268398 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-12ac2c63-416f-43b6-831e-70b074734915 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:51.268858 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-12ac2c63-416f-43b6-831e-70b074734915 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:51.306822 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-12ac2c63-416f-43b6-831e-70b074734915 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058391 Jun 23 13:43:51.307373 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 299/586] 10.222.0.26 () {60 vars in 1342 bytes} [Thu Jun 23 13:43:51 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 13:43:51.921038 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-1b26ed5e-c762-4486-bf20-fcae69f37898 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:51.922190 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-1b26ed5e-c762-4486-bf20-fcae69f37898 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:51.929795 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1b26ed5e-c762-4486-bf20-fcae69f37898 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:51.930300 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1b26ed5e-c762-4486-bf20-fcae69f37898 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:51.931175 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1b26ed5e-c762-4486-bf20-fcae69f37898 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:51.931712 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1b26ed5e-c762-4486-bf20-fcae69f37898 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:52.064714 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-1b26ed5e-c762-4486-bf20-fcae69f37898 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:52.077245 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-1b26ed5e-c762-4486-bf20-fcae69f37898 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1723 microversion: 2.1 time: 0.162505 Jun 23 13:43:52.077867 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 288/587] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:51 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:52.322837 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-08c89fce-4c8c-4c4f-ad95-7d9344f35f7d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:52.324256 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-08c89fce-4c8c-4c4f-ad95-7d9344f35f7d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:52.335534 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-08c89fce-4c8c-4c4f-ad95-7d9344f35f7d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:52.336276 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-08c89fce-4c8c-4c4f-ad95-7d9344f35f7d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:52.337543 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-08c89fce-4c8c-4c4f-ad95-7d9344f35f7d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:52.338272 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-08c89fce-4c8c-4c4f-ad95-7d9344f35f7d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:52.378535 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-08c89fce-4c8c-4c4f-ad95-7d9344f35f7d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062514 Jun 23 13:43:52.379111 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 300/588] 10.222.0.26 () {60 vars in 1342 bytes} [Thu Jun 23 13:43:52 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 13:43:53.097320 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-8a742e5d-42f4-48db-bc8d-f936e6dc3fc2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:53.098051 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-8a742e5d-42f4-48db-bc8d-f936e6dc3fc2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:53.104971 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8a742e5d-42f4-48db-bc8d-f936e6dc3fc2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:53.105416 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8a742e5d-42f4-48db-bc8d-f936e6dc3fc2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:53.106210 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8a742e5d-42f4-48db-bc8d-f936e6dc3fc2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:53.106642 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8a742e5d-42f4-48db-bc8d-f936e6dc3fc2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:53.238814 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-8a742e5d-42f4-48db-bc8d-f936e6dc3fc2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:53.247384 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-8a742e5d-42f4-48db-bc8d-f936e6dc3fc2 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1723 microversion: 2.1 time: 0.154577 Jun 23 13:43:53.247908 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 289/589] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:53 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:53.396893 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-c95b44bc-64f1-4318-9856-1c95e74abe5c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:53.398436 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-c95b44bc-64f1-4318-9856-1c95e74abe5c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:53.412146 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c95b44bc-64f1-4318-9856-1c95e74abe5c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:53.414100 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c95b44bc-64f1-4318-9856-1c95e74abe5c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:53.415796 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c95b44bc-64f1-4318-9856-1c95e74abe5c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:53.416520 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c95b44bc-64f1-4318-9856-1c95e74abe5c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:53.422731 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:43:53.449659 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-c95b44bc-64f1-4318-9856-1c95e74abe5c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060374 Jun 23 13:43:53.450208 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 301/590] 10.222.0.26 () {60 vars in 1342 bytes} [Thu Jun 23 13:43:53 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 13:43:54.267626 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-69f4cf05-742a-4de2-9410-cfc785a792e9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:54.268225 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-69f4cf05-742a-4de2-9410-cfc785a792e9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:54.275020 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-69f4cf05-742a-4de2-9410-cfc785a792e9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:54.275503 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-69f4cf05-742a-4de2-9410-cfc785a792e9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:54.276246 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-69f4cf05-742a-4de2-9410-cfc785a792e9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:54.276820 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-69f4cf05-742a-4de2-9410-cfc785a792e9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:54.295970 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:SELECT=100 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:43:54.410343 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-69f4cf05-742a-4de2-9410-cfc785a792e9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:54.418917 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-69f4cf05-742a-4de2-9410-cfc785a792e9 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1723 microversion: 2.1 time: 0.157098 Jun 23 13:43:54.419612 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 290/591] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:54 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:54.462530 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-72012b48-41d1-4cf6-9f9d-34f81fd973cf tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:54.463526 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-72012b48-41d1-4cf6-9f9d-34f81fd973cf tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:54.470490 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-72012b48-41d1-4cf6-9f9d-34f81fd973cf tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:54.470939 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-72012b48-41d1-4cf6-9f9d-34f81fd973cf tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:54.471739 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-72012b48-41d1-4cf6-9f9d-34f81fd973cf tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:54.472178 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-72012b48-41d1-4cf6-9f9d-34f81fd973cf tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:54.503044 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-72012b48-41d1-4cf6-9f9d-34f81fd973cf tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045255 Jun 23 13:43:54.503632 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 302/592] 10.222.0.26 () {60 vars in 1342 bytes} [Thu Jun 23 13:43:54 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:54.561999 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-86f6cdfe-dfc3-4ae6-b328-776aacc3dd1a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:54.562579 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-86f6cdfe-dfc3-4ae6-b328-776aacc3dd1a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:54.569577 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-86f6cdfe-dfc3-4ae6-b328-776aacc3dd1a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:54.570165 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-86f6cdfe-dfc3-4ae6-b328-776aacc3dd1a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:54.570930 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-86f6cdfe-dfc3-4ae6-b328-776aacc3dd1a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:54.571444 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-86f6cdfe-dfc3-4ae6-b328-776aacc3dd1a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:54.598193 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-86f6cdfe-dfc3-4ae6-b328-776aacc3dd1a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Going to try to terminate instance {{(pid=134666) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 13:43:54.677618 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-86f6cdfe-dfc3-4ae6-b328-776aacc3dd1a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 204 len: 0 microversion: 2.20 time: 0.119634 Jun 23 13:43:54.678250 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 291/593] 10.222.0.26 () {60 vars in 1279 bytes} [Thu Jun 23 13:43:54 2022] DELETE /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 13:43:54.688033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-d49ee1a0-6a36-4e6b-b326-2fd9f44b632a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:54.688647 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-d49ee1a0-6a36-4e6b-b326-2fd9f44b632a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:54.694609 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d49ee1a0-6a36-4e6b-b326-2fd9f44b632a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:54.695053 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d49ee1a0-6a36-4e6b-b326-2fd9f44b632a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:54.695816 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d49ee1a0-6a36-4e6b-b326-2fd9f44b632a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:54.696267 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d49ee1a0-6a36-4e6b-b326-2fd9f44b632a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:55.048979 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-d49ee1a0-6a36-4e6b-b326-2fd9f44b632a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:55.059030 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-d49ee1a0-6a36-4e6b-b326-2fd9f44b632a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:55.060561 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-d49ee1a0-6a36-4e6b-b326-2fd9f44b632a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:55.061713 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-d49ee1a0-6a36-4e6b-b326-2fd9f44b632a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1722 microversion: 2.20 time: 0.377756 Jun 23 13:43:55.062265 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 303/594] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:43:54 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1722 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:43:55.442446 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-ee39bf4e-5b42-4019-899e-28770c423263 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:55.443684 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-ee39bf4e-5b42-4019-899e-28770c423263 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:55.452225 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ee39bf4e-5b42-4019-899e-28770c423263 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:55.452761 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ee39bf4e-5b42-4019-899e-28770c423263 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:55.453446 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ee39bf4e-5b42-4019-899e-28770c423263 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:55.453876 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ee39bf4e-5b42-4019-899e-28770c423263 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:55.587821 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-ee39bf4e-5b42-4019-899e-28770c423263 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:55.599183 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-ee39bf4e-5b42-4019-899e-28770c423263 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1729 microversion: 2.1 time: 0.161129 Jun 23 13:43:55.599953 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 292/595] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:55 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:43:55.617466 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-a0f58c2f-66ff-4f8e-8d14-cbd0c8c2e9bb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:55.618036 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-a0f58c2f-66ff-4f8e-8d14-cbd0c8c2e9bb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:55.624623 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a0f58c2f-66ff-4f8e-8d14-cbd0c8c2e9bb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:55.625034 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a0f58c2f-66ff-4f8e-8d14-cbd0c8c2e9bb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:55.625791 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a0f58c2f-66ff-4f8e-8d14-cbd0c8c2e9bb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:55.626255 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a0f58c2f-66ff-4f8e-8d14-cbd0c8c2e9bb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:55.710052 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-a0f58c2f-66ff-4f8e-8d14-cbd0c8c2e9bb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096327 Jun 23 13:43:55.710680 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 304/596] 10.222.0.26 () {58 vars in 1274 bytes} [Thu Jun 23 13:43:55 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 13:43:56.086241 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-dcbebdc3-e285-4dad-8ce8-1a7204846ce9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:56.086857 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-dcbebdc3-e285-4dad-8ce8-1a7204846ce9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:56.094045 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-dcbebdc3-e285-4dad-8ce8-1a7204846ce9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:56.094501 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-dcbebdc3-e285-4dad-8ce8-1a7204846ce9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:56.095263 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-dcbebdc3-e285-4dad-8ce8-1a7204846ce9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:56.095775 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-dcbebdc3-e285-4dad-8ce8-1a7204846ce9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:56.225436 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-dcbebdc3-e285-4dad-8ce8-1a7204846ce9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:56.234310 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-dcbebdc3-e285-4dad-8ce8-1a7204846ce9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:56.235849 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-dcbebdc3-e285-4dad-8ce8-1a7204846ce9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:56.237022 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-dcbebdc3-e285-4dad-8ce8-1a7204846ce9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1722 microversion: 2.20 time: 0.155304 Jun 23 13:43:56.237585 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 293/597] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:43:56 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:43:56.596242 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-e6d271e2-2d0c-4e51-ab16-f09f2a186316 req-2e7dc2c5-c719-4db9-a700-926af7ce2c80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb", "tag": "60ed90f0-c222-4a32-aa94-aa23838b7b54"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:43:56.604500 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-e6d271e2-2d0c-4e51-ab16-f09f2a186316 req-2e7dc2c5-c719-4db9-a700-926af7ce2c80 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:56.604938 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-e6d271e2-2d0c-4e51-ab16-f09f2a186316 req-2e7dc2c5-c719-4db9-a700-926af7ce2c80 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:56.616459 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-e6d271e2-2d0c-4e51-ab16-f09f2a186316 req-2e7dc2c5-c719-4db9-a700-926af7ce2c80 service nova] Creating event network-changed:60ed90f0-c222-4a32-aa94-aa23838b7b54 for instance d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb on hv-cinder-81558 Jun 23 13:43:56.623366 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-e6d271e2-2d0c-4e51-ab16-f09f2a186316 req-2e7dc2c5-c719-4db9-a700-926af7ce2c80 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030263 Jun 23 13:43:56.623883 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 305/598] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:43:57.255916 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-ff5908b0-eb47-4411-88a5-d04603ea7c8c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:57.257433 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-ff5908b0-eb47-4411-88a5-d04603ea7c8c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:57.265420 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ff5908b0-eb47-4411-88a5-d04603ea7c8c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:57.266293 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ff5908b0-eb47-4411-88a5-d04603ea7c8c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:57.267165 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ff5908b0-eb47-4411-88a5-d04603ea7c8c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:57.267853 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ff5908b0-eb47-4411-88a5-d04603ea7c8c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:57.403553 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-ff5908b0-eb47-4411-88a5-d04603ea7c8c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:57.412743 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-ff5908b0-eb47-4411-88a5-d04603ea7c8c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:57.414252 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-ff5908b0-eb47-4411-88a5-d04603ea7c8c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:57.415444 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-ff5908b0-eb47-4411-88a5-d04603ea7c8c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1722 microversion: 2.20 time: 0.163528 Jun 23 13:43:57.416200 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 294/599] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:43:57 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:43:57.618162 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-58fe6d56-cda5-4b40-82e8-86115e6f406d tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:57.618841 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-58fe6d56-cda5-4b40-82e8-86115e6f406d tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: 7fb7c75c-c825-43e8-a4f0-43b5e62331a9] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:57.626147 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-58fe6d56-cda5-4b40-82e8-86115e6f406d tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:57.626834 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-58fe6d56-cda5-4b40-82e8-86115e6f406d tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:57.627604 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-58fe6d56-cda5-4b40-82e8-86115e6f406d tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:57.628111 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-58fe6d56-cda5-4b40-82e8-86115e6f406d tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:57.717140 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.objects.instance [None req-58fe6d56-cda5-4b40-82e8-86115e6f406d tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lazy-loading 'services' on Instance uuid 7fb7c75c-c825-43e8-a4f0-43b5e62331a9 {{(pid=134667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:43:57.791357 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-58fe6d56-cda5-4b40-82e8-86115e6f406d tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9/os-volume_attachments/86268fbe-0e6b-4245-8039-35980b2a8878" status: 202 len: 0 microversion: 2.1 time: 0.176913 Jun 23 13:43:57.794800 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 306/600] 10.222.0.26 () {58 vars in 1415 bytes} [Thu Jun 23 13:43:57 2022] DELETE /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9/os-volume_attachments/86268fbe-0e6b-4245-8039-35980b2a8878 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 13:43:58.433870 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-62239669-10d5-4073-a744-2bd7897daddc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:58.434425 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-62239669-10d5-4073-a744-2bd7897daddc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:58.441577 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-62239669-10d5-4073-a744-2bd7897daddc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:58.442032 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-62239669-10d5-4073-a744-2bd7897daddc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:58.442802 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-62239669-10d5-4073-a744-2bd7897daddc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:58.443241 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-62239669-10d5-4073-a744-2bd7897daddc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:58.536764 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-62239669-10d5-4073-a744-2bd7897daddc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:58.545643 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-62239669-10d5-4073-a744-2bd7897daddc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:58.547623 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-62239669-10d5-4073-a744-2bd7897daddc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:58.549521 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-62239669-10d5-4073-a744-2bd7897daddc tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1655 microversion: 2.20 time: 0.119699 Jun 23 13:43:58.561541 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 295/601] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:43:58 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1655 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:43:58.641876 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-f356f403-e5b6-454c-8900-51be81a4dc2c req-6407dda5-b134-4a91-b87a-8cf1969cd685 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb", "tag": "60ed90f0-c222-4a32-aa94-aa23838b7b54"}, {"server_uuid": "b9ddb941-db20-4a0c-b841-d99368ad4f21", "name": "network-vif-deleted", "tag": "07687dd4-8eaf-46e2-8bcb-86dc90291b87"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:43:58.652909 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-f356f403-e5b6-454c-8900-51be81a4dc2c req-6407dda5-b134-4a91-b87a-8cf1969cd685 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:58.653351 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-f356f403-e5b6-454c-8900-51be81a4dc2c req-6407dda5-b134-4a91-b87a-8cf1969cd685 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:58.668358 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-f356f403-e5b6-454c-8900-51be81a4dc2c req-6407dda5-b134-4a91-b87a-8cf1969cd685 service nova] Creating event network-changed:60ed90f0-c222-4a32-aa94-aa23838b7b54 for instance d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb on hv-cinder-81558 Jun 23 13:43:58.669137 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-f356f403-e5b6-454c-8900-51be81a4dc2c req-6407dda5-b134-4a91-b87a-8cf1969cd685 service nova] Creating event network-vif-deleted:07687dd4-8eaf-46e2-8bcb-86dc90291b87 for instance b9ddb941-db20-4a0c-b841-d99368ad4f21 on hv-cinder-81558 Jun 23 13:43:58.675941 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-f356f403-e5b6-454c-8900-51be81a4dc2c req-6407dda5-b134-4a91-b87a-8cf1969cd685 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.039316 Jun 23 13:43:58.676838 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 307/602] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:43:58.918014 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-75ade0e1-2f25-4656-869e-7a12f5ac0672 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:58.918508 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-75ade0e1-2f25-4656-869e-7a12f5ac0672 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: 7fb7c75c-c825-43e8-a4f0-43b5e62331a9] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:58.924741 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-75ade0e1-2f25-4656-869e-7a12f5ac0672 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:58.925183 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-75ade0e1-2f25-4656-869e-7a12f5ac0672 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:58.925936 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-75ade0e1-2f25-4656-869e-7a12f5ac0672 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:58.926365 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-75ade0e1-2f25-4656-869e-7a12f5ac0672 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:58.952176 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-75ade0e1-2f25-4656-869e-7a12f5ac0672 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: 7fb7c75c-c825-43e8-a4f0-43b5e62331a9] Going to try to terminate instance {{(pid=134666) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 13:43:59.061733 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-75ade0e1-2f25-4656-869e-7a12f5ac0672 tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9" status: 204 len: 0 microversion: 2.1 time: 0.143762 Jun 23 13:43:59.063493 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 296/603] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Jun 23 13:43:58 2022] DELETE /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 13:43:59.070964 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-c87998b2-2b9f-4c0b-ae0f-698240acd01c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:59.071802 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-c87998b2-2b9f-4c0b-ae0f-698240acd01c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: 7fb7c75c-c825-43e8-a4f0-43b5e62331a9] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:59.083292 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c87998b2-2b9f-4c0b-ae0f-698240acd01c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:59.083845 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c87998b2-2b9f-4c0b-ae0f-698240acd01c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:59.084693 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c87998b2-2b9f-4c0b-ae0f-698240acd01c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:59.085211 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c87998b2-2b9f-4c0b-ae0f-698240acd01c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:59.221393 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-c87998b2-2b9f-4c0b-ae0f-698240acd01c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:59.229408 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-c87998b2-2b9f-4c0b-ae0f-698240acd01c tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9" status: 200 len: 1512 microversion: 2.1 time: 0.163164 Jun 23 13:43:59.229991 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 308/604] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:43:59 2022] GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:43:59.573968 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-ec3ad013-0e52-462e-b54e-5cc32d35c8b3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:43:59.575153 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-ec3ad013-0e52-462e-b54e-5cc32d35c8b3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:43:59.583524 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ec3ad013-0e52-462e-b54e-5cc32d35c8b3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:59.583973 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ec3ad013-0e52-462e-b54e-5cc32d35c8b3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:59.584744 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ec3ad013-0e52-462e-b54e-5cc32d35c8b3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:59.585201 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ec3ad013-0e52-462e-b54e-5cc32d35c8b3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:59.616683 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ec3ad013-0e52-462e-b54e-5cc32d35c8b3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:43:59.617129 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ec3ad013-0e52-462e-b54e-5cc32d35c8b3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:43:59.617568 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.objects.instance [None req-ec3ad013-0e52-462e-b54e-5cc32d35c8b3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lazy-loading 'fault' on Instance uuid b9ddb941-db20-4a0c-b841-d99368ad4f21 {{(pid=134666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:43:59.665305 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-ec3ad013-0e52-462e-b54e-5cc32d35c8b3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:59.673896 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-ec3ad013-0e52-462e-b54e-5cc32d35c8b3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:59.675387 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-ec3ad013-0e52-462e-b54e-5cc32d35c8b3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:43:59.676571 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-ec3ad013-0e52-462e-b54e-5cc32d35c8b3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1371 microversion: 2.20 time: 0.109897 Jun 23 13:43:59.677133 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 297/605] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:43:59 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1371 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:44:00.250298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-99e87760-ebf0-4b5b-92ea-5fc23551df4b tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:00.251276 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-99e87760-ebf0-4b5b-92ea-5fc23551df4b tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: 7fb7c75c-c825-43e8-a4f0-43b5e62331a9] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:00.262246 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-99e87760-ebf0-4b5b-92ea-5fc23551df4b tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:00.263009 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-99e87760-ebf0-4b5b-92ea-5fc23551df4b tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:00.264459 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-99e87760-ebf0-4b5b-92ea-5fc23551df4b tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:00.265196 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-99e87760-ebf0-4b5b-92ea-5fc23551df4b tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:00.401798 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-99e87760-ebf0-4b5b-92ea-5fc23551df4b tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:00.410922 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-99e87760-ebf0-4b5b-92ea-5fc23551df4b tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9" status: 200 len: 1512 microversion: 2.1 time: 0.167235 Jun 23 13:44:00.411553 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 309/606] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:00 2022] GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9 => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:00.696099 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-84ba2113-dcdc-473d-87ec-4ff4750f8f60 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:00.696752 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-84ba2113-dcdc-473d-87ec-4ff4750f8f60 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:00.704136 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-84ba2113-dcdc-473d-87ec-4ff4750f8f60 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:00.704672 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-84ba2113-dcdc-473d-87ec-4ff4750f8f60 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:00.705544 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-84ba2113-dcdc-473d-87ec-4ff4750f8f60 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:00.706030 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-84ba2113-dcdc-473d-87ec-4ff4750f8f60 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:00.740943 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-84ba2113-dcdc-473d-87ec-4ff4750f8f60 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:00.741363 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-84ba2113-dcdc-473d-87ec-4ff4750f8f60 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:00.741819 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.objects.instance [None req-84ba2113-dcdc-473d-87ec-4ff4750f8f60 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lazy-loading 'fault' on Instance uuid b9ddb941-db20-4a0c-b841-d99368ad4f21 {{(pid=134666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:44:00.783758 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-84ba2113-dcdc-473d-87ec-4ff4750f8f60 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:00.791109 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-84ba2113-dcdc-473d-87ec-4ff4750f8f60 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:00.792740 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-84ba2113-dcdc-473d-87ec-4ff4750f8f60 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:00.794027 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-84ba2113-dcdc-473d-87ec-4ff4750f8f60 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 200 len: 1371 microversion: 2.20 time: 0.102363 Jun 23 13:44:00.796966 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 298/607] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:44:00 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:44:01.433945 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-360a9b18-3f19-4720-8a4a-6fe960660ddf tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:01.434565 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-360a9b18-3f19-4720-8a4a-6fe960660ddf tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: 7fb7c75c-c825-43e8-a4f0-43b5e62331a9] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:01.441668 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-360a9b18-3f19-4720-8a4a-6fe960660ddf tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:01.442477 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-360a9b18-3f19-4720-8a4a-6fe960660ddf tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:01.443250 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-360a9b18-3f19-4720-8a4a-6fe960660ddf tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:01.443717 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-360a9b18-3f19-4720-8a4a-6fe960660ddf tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:01.576200 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-360a9b18-3f19-4720-8a4a-6fe960660ddf tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fd8fce7c040433e908a4fe6c6b13e08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed01b7f521c413e944560db54281ebc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:01.584601 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-360a9b18-3f19-4720-8a4a-6fe960660ddf tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9" status: 200 len: 1512 microversion: 2.1 time: 0.154663 Jun 23 13:44:01.585141 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 310/608] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:01 2022] GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:01.768910 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-ef2c365e-6469-4bd5-b7a0-b198a50eb587 req-9eabfedb-33f7-461a-a895-ba3177d8d255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fb7c75c-c825-43e8-a4f0-43b5e62331a9", "name": "network-vif-deleted", "tag": "88903506-2ee3-475a-84a2-3a390f1bd829"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:44:01.777979 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-ef2c365e-6469-4bd5-b7a0-b198a50eb587 req-9eabfedb-33f7-461a-a895-ba3177d8d255 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:01.778344 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-ef2c365e-6469-4bd5-b7a0-b198a50eb587 req-9eabfedb-33f7-461a-a895-ba3177d8d255 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:01.790068 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-ef2c365e-6469-4bd5-b7a0-b198a50eb587 req-9eabfedb-33f7-461a-a895-ba3177d8d255 service nova] Creating event network-vif-deleted:88903506-2ee3-475a-84a2-3a390f1bd829 for instance 7fb7c75c-c825-43e8-a4f0-43b5e62331a9 on hv-cinder-81558 Jun 23 13:44:01.795276 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-ef2c365e-6469-4bd5-b7a0-b198a50eb587 req-9eabfedb-33f7-461a-a895-ba3177d8d255 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030177 Jun 23 13:44:01.795930 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 299/609] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:44:01.811118 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-a72cfdd3-8437-4c51-b06b-9d88b17b2dc1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:01.811879 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-a72cfdd3-8437-4c51-b06b-9d88b17b2dc1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:01.818940 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a72cfdd3-8437-4c51-b06b-9d88b17b2dc1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:01.818940 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a72cfdd3-8437-4c51-b06b-9d88b17b2dc1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:01.819868 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a72cfdd3-8437-4c51-b06b-9d88b17b2dc1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:01.820528 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a72cfdd3-8437-4c51-b06b-9d88b17b2dc1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:01.835275 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.wsgi [None req-a72cfdd3-8437-4c51-b06b-9d88b17b2dc1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] HTTP exception thrown: Instance b9ddb941-db20-4a0c-b841-d99368ad4f21 could not be found. Jun 23 13:44:01.836971 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-a72cfdd3-8437-4c51-b06b-9d88b17b2dc1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Request method failure captured: Jun 23 13:44:01.836971 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 HTTP/1.1 Jun 23 13:44:01.836971 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:44:01.836971 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:44:01.836971 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:44:01.836971 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 0 Jun 23 13:44:01.836971 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:44:01.836971 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:44:01.836971 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:44:01.836971 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:44:01.836971 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitG0Ua982nkIhWp-3rSlmbNhDgpXavmmlJ3cnUqm5xRHstr9N-gjiygFKqK1B5pPVIF2q-J75rZdWvIRlWcHf1cTERPdk9LhP6fmwjGS6rFkXRDEXvEkbTis7iFpUzIwRQUytgSw1sNI5BnjCcre3LSfuww5z9q0LC5x-OGRhWUeiyp8 Jun 23 13:44:01.836971 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:44:01.836971 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:44:01.836971 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:44:01.836971 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:44:01.836971 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 13:44:01.836971 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:44:01.836971 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:44:01.836971 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: 1d89deaaefc541739f67ab1e53c4bda3 Jun 23 13:44:01.836971 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1861648293 Jun 23 13:44:01.836971 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:44:01.836971 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:44:01.838333 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1d89deaaefc541739f67ab1e53c4bda3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1d89deaaefc541739f67ab1e53c4bda3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1d89deaaefc541739f67ab1e53c4bda3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1d89deaaefc541739f67ab1e53c4bda3", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:44:01.838333 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1861648293 Jun 23 13:44:01.838333 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: 1d89deaaefc541739f67ab1e53c4bda3 Jun 23 13:44:01.838333 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1861648293 Jun 23 13:44:01.838333 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-AttachVolumeShelveTestJSON-1861648293-project Jun 23 13:44:01.838333 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:44:01.838333 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:44:01.838333 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: b191f41e53064acbaf17e3da073e7c85 Jun 23 13:44:01.838333 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1861648293-project Jun 23 13:44:01.838333 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: > Jun 23 13:44:01.838333 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Instance b9ddb941-db20-4a0c-b841-d99368ad4f21 could not be found. Jun 23 13:44:01.838333 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'id': 'b9ddb941-db20-4a0c-b841-d99368ad4f21'} Jun 23 13:44:01.839123 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:44:01.839123 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:44:01.839123 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:44:01.839123 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:44:01.839123 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:44:01.839123 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:44:01.839123 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:44:01.839123 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:44:01.839123 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:44:01.839123 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:44:01.839123 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9ddb941-db20-4a0c-b841-d99368ad4f21 could not be found. Jun 23 13:44:01.839123 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:44:01.839123 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:44:01.839123 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:44:01.839123 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:44:01.839123 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:44:01.839123 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:44:01.839123 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:44:01.839123 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:44:01.839123 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:44:01.840328 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:44:01.840328 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:44:01.840328 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:44:01.840328 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:44:01.840328 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:44:01.840328 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:44:01.840328 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:44:01.840328 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9ddb941-db20-4a0c-b841-d99368ad4f21 could not be found. Jun 23 13:44:01.840328 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:44:01.840328 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:44:01.840328 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:44:01.840328 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:44:01.840328 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:44:01.840328 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:44:01.840328 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:44:01.840328 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:44:01.840328 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9ddb941-db20-4a0c-b841-d99368ad4f21 could not be found. Jun 23 13:44:01.840328 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:44:01.841614 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-a72cfdd3-8437-4c51-b06b-9d88b17b2dc1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Returning 404 to user: Instance b9ddb941-db20-4a0c-b841-d99368ad4f21 could not be found. {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:44:01.841614 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-a72cfdd3-8437-4c51-b06b-9d88b17b2dc1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 404 len: 111 microversion: 2.20 time: 0.031236 Jun 23 13:44:01.841614 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 311/610] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:44:01 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 13:44:01.848107 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-71c5411a-35cf-4d21-a2a1-4aa2314ee6a7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '.version_select at 0x7fd77238aca0>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:01.866848 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-71c5411a-35cf-4d21-a2a1-4aa2314ee6a7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-378981695" status: 204 len: 0 microversion: 2.20 time: 0.022961 Jun 23 13:44:01.867458 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 300/611] 10.222.0.26 () {60 vars in 1258 bytes} [Thu Jun 23 13:44:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-378981695 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 23 13:44:02.505248 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-9d4f45a8-31ef-4a44-8a48-3855c59e0644 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Action: 'create', calling method: .version_select at 0x7fd772253700>, body: {"keypair": {"name": "tempest-keypair-629360403", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDi7MObIoapuA5eX9AQCIxokfnBkJZP7s2d6v+Wn6smvoeCZivUNrNYIjqlszZ0DNcNBqlAFdUMT8vYXUp8Yh0/SCxNYqqgh8z3zNnPr4X8NPsFmCZZbjLcWDmIFXo2mw=="}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:44:02.520892 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.quota [None req-9d4f45a8-31ef-4a44-8a48-3855c59e0644 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Getting quotas for project 1d89deaaefc541739f67ab1e53c4bda3. Resources: {'key_pairs'} {{(pid=134667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:44:02.525158 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.quota [None req-9d4f45a8-31ef-4a44-8a48-3855c59e0644 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Getting quotas for user b191f41e53064acbaf17e3da073e7c85 and project 1d89deaaefc541739f67ab1e53c4bda3. Resources: {'key_pairs'} {{(pid=134667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:44:02.549607 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-9d4f45a8-31ef-4a44-8a48-3855c59e0644 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.048204 Jun 23 13:44:02.550080 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 312/612] 10.222.0.26 () {62 vars in 1199 bytes} [Thu Jun 23 13:44:02 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 23 13:44:02.602175 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-853eda04-11f8-4cd7-b80d-c8b6675ffb3a tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:02.603050 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-853eda04-11f8-4cd7-b80d-c8b6675ffb3a tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] [instance: 7fb7c75c-c825-43e8-a4f0-43b5e62331a9] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:02.609929 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-853eda04-11f8-4cd7-b80d-c8b6675ffb3a tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:02.610382 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-853eda04-11f8-4cd7-b80d-c8b6675ffb3a tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:02.611196 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-853eda04-11f8-4cd7-b80d-c8b6675ffb3a tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:02.611707 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-853eda04-11f8-4cd7-b80d-c8b6675ffb3a tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:02.625817 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.wsgi [None req-853eda04-11f8-4cd7-b80d-c8b6675ffb3a tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] HTTP exception thrown: Instance 7fb7c75c-c825-43e8-a4f0-43b5e62331a9 could not be found. Jun 23 13:44:02.627545 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-853eda04-11f8-4cd7-b80d-c8b6675ffb3a tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Request method failure captured: Jun 23 13:44:02.627545 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: request: GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9 HTTP/1.1 Jun 23 13:44:02.627545 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept: application/json Jun 23 13:44:02.627545 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept-Encoding: identity Jun 23 13:44:02.627545 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Connection: close Jun 23 13:44:02.627545 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Length: 0 Jun 23 13:44:02.627545 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Type: application/json Jun 23 13:44:02.627545 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Host: 10.222.0.26 Jun 23 13:44:02.627545 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Openstack-System-Scope: None Jun 23 13:44:02.627545 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: User-Agent: python-urllib3/1.26.9 Jun 23 13:44:02.627545 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Auth-Token: gAAAAABitG16TJmP_rpOoAzFJB8B07sO1fB6YsjME2jnHOI6NkuAQt9oHn8VeRwvM6BEAnK3w8-SsKukrofLE1CYSJs2DN0bybigREVN3dt2lZQN6xKF0BGyiIH7oz-nonTarQrHJfHJcgiY295aTkHJtONeJV2Az5h3cTzdbbxmqypFuIfuz_4 Jun 23 13:44:02.627545 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Id: None Jun 23 13:44:02.627545 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Name: None Jun 23 13:44:02.627545 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Identity-Status: Confirmed Jun 23 13:44:02.627545 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Is-Admin-Project: True Jun 23 13:44:02.627545 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Id: default Jun 23 13:44:02.627545 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Name: Default Jun 23 13:44:02.627545 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Id: 5ed01b7f521c413e944560db54281ebc Jun 23 13:44:02.627545 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Name: tempest-VolumesSnapshotTestJSON-209705941 Jun 23 13:44:02.627545 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Role: member,reader Jun 23 13:44:02.627545 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Roles: member,reader Jun 23 13:44:02.628985 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5ed01b7f521c413e944560db54281ebc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5ed01b7f521c413e944560db54281ebc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5ed01b7f521c413e944560db54281ebc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5ed01b7f521c413e944560db54281ebc", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:44:02.628985 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant: tempest-VolumesSnapshotTestJSON-209705941 Jun 23 13:44:02.628985 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Id: 5ed01b7f521c413e944560db54281ebc Jun 23 13:44:02.628985 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-209705941 Jun 23 13:44:02.628985 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User: tempest-VolumesSnapshotTestJSON-209705941-project Jun 23 13:44:02.628985 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Id: default Jun 23 13:44:02.628985 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Name: Default Jun 23 13:44:02.628985 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Id: 7fd8fce7c040433e908a4fe6c6b13e08 Jun 23 13:44:02.628985 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Name: tempest-VolumesSnapshotTestJSON-209705941-project Jun 23 13:44:02.628985 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: method: > Jun 23 13:44:02.628985 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: exception: Instance 7fb7c75c-c825-43e8-a4f0-43b5e62331a9 could not be found. Jun 23 13:44:02.628985 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: action_args: {'id': '7fb7c75c-c825-43e8-a4f0-43b5e62331a9'} Jun 23 13:44:02.629766 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:44:02.629766 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:44:02.629766 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:44:02.629766 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:44:02.629766 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:44:02.629766 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:44:02.629766 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:44:02.629766 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:44:02.629766 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:44:02.629766 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:44:02.629766 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fb7c75c-c825-43e8-a4f0-43b5e62331a9 could not be found. Jun 23 13:44:02.629766 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:44:02.629766 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:44:02.629766 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:44:02.629766 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:44:02.629766 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:44:02.629766 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:44:02.629766 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:44:02.629766 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:44:02.629766 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:44:02.630982 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:44:02.630982 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:44:02.630982 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:44:02.630982 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:44:02.630982 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:44:02.630982 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:44:02.630982 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:44:02.630982 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fb7c75c-c825-43e8-a4f0-43b5e62331a9 could not be found. Jun 23 13:44:02.630982 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:44:02.630982 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:44:02.630982 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:44:02.630982 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:44:02.630982 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:44:02.630982 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:44:02.630982 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:44:02.630982 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:44:02.630982 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fb7c75c-c825-43e8-a4f0-43b5e62331a9 could not be found. Jun 23 13:44:02.630982 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:44:02.632072 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-853eda04-11f8-4cd7-b80d-c8b6675ffb3a tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] Returning 404 to user: Instance 7fb7c75c-c825-43e8-a4f0-43b5e62331a9 could not be found. {{(pid=134666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:44:02.632072 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-853eda04-11f8-4cd7-b80d-c8b6675ffb3a tempest-VolumesSnapshotTestJSON-209705941 tempest-VolumesSnapshotTestJSON-209705941-project] 10.222.0.26 "GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9" status: 404 len: 111 microversion: 2.1 time: 0.030914 Jun 23 13:44:02.632072 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 301/613] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:02 2022] GET /compute/v2.1/servers/7fb7c75c-c825-43e8-a4f0-43b5e62331a9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:44:03.904988 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-718ee8b7-0b8b-4fc5-a145-317bfbf46c1e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1519358777", "imageRef": "dd7aacbf-3b3e-496e-967e-53d2a1b1f200", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "13de077c-d4db-4fa7-84a8-7023d19899e5"}], "security_groups": [{"name": "tempest-securitygroup--1661217283"}], "key_name": "tempest-keypair-629360403", "user_data": "}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:44:04.009326 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.network.neutron [None req-718ee8b7-0b8b-4fc5-a145-317bfbf46c1e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] validate_networks() for [('13de077c-d4db-4fa7-84a8-7023d19899e5', None, None, None, None, None)] {{(pid=134667) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 13:44:04.393998 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-718ee8b7-0b8b-4fc5-a145-317bfbf46c1e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Flavor limits 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 13:44:04.394520 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-718ee8b7-0b8b-4fc5-a145-317bfbf46c1e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Image limits 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 13:44:04.395064 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-718ee8b7-0b8b-4fc5-a145-317bfbf46c1e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Flavor pref 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 13:44:04.395578 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-718ee8b7-0b8b-4fc5-a145-317bfbf46c1e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Image pref 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 13:44:04.396100 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-718ee8b7-0b8b-4fc5-a145-317bfbf46c1e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 13:44:04.408078 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-718ee8b7-0b8b-4fc5-a145-317bfbf46c1e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:04.408531 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-718ee8b7-0b8b-4fc5-a145-317bfbf46c1e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:04.409375 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-718ee8b7-0b8b-4fc5-a145-317bfbf46c1e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:04.409814 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-718ee8b7-0b8b-4fc5-a145-317bfbf46c1e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:04.426780 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.quota [None req-718ee8b7-0b8b-4fc5-a145-317bfbf46c1e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Getting quotas for project 1d89deaaefc541739f67ab1e53c4bda3. Resources: {'ram', 'cores', 'instances'} {{(pid=134667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:44:04.430914 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.quota [None req-718ee8b7-0b8b-4fc5-a145-317bfbf46c1e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Getting quotas for user b191f41e53064acbaf17e3da073e7c85 and project 1d89deaaefc541739f67ab1e53c4bda3. Resources: {'ram', 'cores', 'instances'} {{(pid=134667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:44:04.442439 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-718ee8b7-0b8b-4fc5-a145-317bfbf46c1e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Going to run 1 instances... {{(pid=134667) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 13:44:04.444773 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-718ee8b7-0b8b-4fc5-a145-317bfbf46c1e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7aacbf-3b3e-496e-967e-53d2a1b1f200',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134667) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 13:44:04.503446 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-718ee8b7-0b8b-4fc5-a145-317bfbf46c1e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.603072 Jun 23 13:44:04.504220 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 313/614] 10.222.0.26 () {62 vars in 1187 bytes} [Thu Jun 23 13:44:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 23 13:44:04.514380 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-63f8cafd-ab20-4e76-ad52-efeedce5dc75 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:04.514994 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-63f8cafd-ab20-4e76-ad52-efeedce5dc75 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:04.570638 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-63f8cafd-ab20-4e76-ad52-efeedce5dc75 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:04.578304 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-63f8cafd-ab20-4e76-ad52-efeedce5dc75 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:04.579822 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-63f8cafd-ab20-4e76-ad52-efeedce5dc75 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:04.581002 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-63f8cafd-ab20-4e76-ad52-efeedce5dc75 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1281 microversion: 2.20 time: 0.070526 Jun 23 13:44:04.581544 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 302/615] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:44:04 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:44:05.604300 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-8a1769ac-8650-4abd-b792-1c0e28f5072e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:05.605301 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-8a1769ac-8650-4abd-b792-1c0e28f5072e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:05.613899 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8a1769ac-8650-4abd-b792-1c0e28f5072e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:05.614356 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8a1769ac-8650-4abd-b792-1c0e28f5072e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:05.615119 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8a1769ac-8650-4abd-b792-1c0e28f5072e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:05.615599 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8a1769ac-8650-4abd-b792-1c0e28f5072e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:05.675166 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-8a1769ac-8650-4abd-b792-1c0e28f5072e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:05.683162 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-8a1769ac-8650-4abd-b792-1c0e28f5072e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:05.684706 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-8a1769ac-8650-4abd-b792-1c0e28f5072e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:05.685823 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-8a1769ac-8650-4abd-b792-1c0e28f5072e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1285 microversion: 2.20 time: 0.088999 Jun 23 13:44:05.686370 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 314/616] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:44:05 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:44:06.711969 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-90290c67-8368-4db6-9aba-b0122744719f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:06.712817 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-90290c67-8368-4db6-9aba-b0122744719f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:06.722554 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-90290c67-8368-4db6-9aba-b0122744719f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:06.723002 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-90290c67-8368-4db6-9aba-b0122744719f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:06.723815 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-90290c67-8368-4db6-9aba-b0122744719f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:06.724209 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-90290c67-8368-4db6-9aba-b0122744719f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:06.796916 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-90290c67-8368-4db6-9aba-b0122744719f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:06.807837 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-90290c67-8368-4db6-9aba-b0122744719f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:06.809872 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-90290c67-8368-4db6-9aba-b0122744719f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:06.811589 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-90290c67-8368-4db6-9aba-b0122744719f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1277 microversion: 2.20 time: 0.105276 Jun 23 13:44:06.812275 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 303/617] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:44:06 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1277 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:44:07.836053 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-374917f8-b604-409a-9229-d3d3436d3713 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:07.836619 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-374917f8-b604-409a-9229-d3d3436d3713 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:07.839260 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:44:07.847889 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-374917f8-b604-409a-9229-d3d3436d3713 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:07.848367 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-374917f8-b604-409a-9229-d3d3436d3713 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:07.849184 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-374917f8-b604-409a-9229-d3d3436d3713 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:07.849624 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-374917f8-b604-409a-9229-d3d3436d3713 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:07.913852 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-374917f8-b604-409a-9229-d3d3436d3713 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:07.922575 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-374917f8-b604-409a-9229-d3d3436d3713 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:07.924445 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-374917f8-b604-409a-9229-d3d3436d3713 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:07.925784 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-374917f8-b604-409a-9229-d3d3436d3713 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1339 microversion: 2.20 time: 0.094135 Jun 23 13:44:07.926333 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 315/618] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:44:07 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1339 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:44:08.943805 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-ec82c270-1c2c-41da-aa9e-78b7e477f942 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:08.944413 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-ec82c270-1c2c-41da-aa9e-78b7e477f942 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:08.951319 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ec82c270-1c2c-41da-aa9e-78b7e477f942 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:08.952123 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ec82c270-1c2c-41da-aa9e-78b7e477f942 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:08.953225 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ec82c270-1c2c-41da-aa9e-78b7e477f942 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:08.953814 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ec82c270-1c2c-41da-aa9e-78b7e477f942 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:09.008736 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-ea650410-65f8-4ea7-9ab8-259df2471e38 req-eb747d23-35dd-4b44-b875-30427cc754e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a602a74c-fbf6-4ed0-85c6-f1778d879da7", "tag": "2a2fc7e3-801b-47fb-9626-bb5520448495"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:44:09.027964 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-ea650410-65f8-4ea7-9ab8-259df2471e38 req-eb747d23-35dd-4b44-b875-30427cc754e7 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:09.028541 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-ea650410-65f8-4ea7-9ab8-259df2471e38 req-eb747d23-35dd-4b44-b875-30427cc754e7 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:09.041027 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-ea650410-65f8-4ea7-9ab8-259df2471e38 req-eb747d23-35dd-4b44-b875-30427cc754e7 service nova] Creating event network-changed:2a2fc7e3-801b-47fb-9626-bb5520448495 for instance a602a74c-fbf6-4ed0-85c6-f1778d879da7 on hv-cinder-81558 Jun 23 13:44:09.047244 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-ea650410-65f8-4ea7-9ab8-259df2471e38 req-eb747d23-35dd-4b44-b875-30427cc754e7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046854 Jun 23 13:44:09.048206 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 316/619] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:44:09.123221 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-ec82c270-1c2c-41da-aa9e-78b7e477f942 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:09.131918 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-ec82c270-1c2c-41da-aa9e-78b7e477f942 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:09.133467 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-ec82c270-1c2c-41da-aa9e-78b7e477f942 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:09.134627 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-ec82c270-1c2c-41da-aa9e-78b7e477f942 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1407 microversion: 2.20 time: 0.195156 Jun 23 13:44:09.135184 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 304/620] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:44:08 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:44:10.153942 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-43d65e20-fc58-49dd-b3c1-5af21aa15781 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:10.154633 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-43d65e20-fc58-49dd-b3c1-5af21aa15781 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:10.162676 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-43d65e20-fc58-49dd-b3c1-5af21aa15781 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:10.163110 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-43d65e20-fc58-49dd-b3c1-5af21aa15781 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:10.163903 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-43d65e20-fc58-49dd-b3c1-5af21aa15781 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:10.164383 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-43d65e20-fc58-49dd-b3c1-5af21aa15781 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:10.305470 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-43d65e20-fc58-49dd-b3c1-5af21aa15781 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:10.313699 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-43d65e20-fc58-49dd-b3c1-5af21aa15781 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:10.315232 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-43d65e20-fc58-49dd-b3c1-5af21aa15781 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:10.316367 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-43d65e20-fc58-49dd-b3c1-5af21aa15781 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1407 microversion: 2.20 time: 0.167340 Jun 23 13:44:10.316933 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 317/621] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:44:10 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:44:10.579971 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-7e5a6007-efd2-4e72-9494-47aa2456371c tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:44:10.580911 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-7e5a6007-efd2-4e72-9494-47aa2456371c tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:10.588728 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7e5a6007-efd2-4e72-9494-47aa2456371c tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:10.589254 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7e5a6007-efd2-4e72-9494-47aa2456371c tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:10.590088 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7e5a6007-efd2-4e72-9494-47aa2456371c tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:10.590567 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7e5a6007-efd2-4e72-9494-47aa2456371c tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:10.642716 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:44:10.675226 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-7e5a6007-efd2-4e72-9494-47aa2456371c tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "POST /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6/action" status: 202 len: 0 microversion: 2.1 time: 0.101192 Jun 23 13:44:10.675909 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 305/622] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Jun 23 13:44:10 2022] POST /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 13:44:10.684199 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-7d228bb4-3b8b-4113-a3ff-b7e70d52c074 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:10.685353 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-7d228bb4-3b8b-4113-a3ff-b7e70d52c074 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:10.691558 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7d228bb4-3b8b-4113-a3ff-b7e70d52c074 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:10.692012 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7d228bb4-3b8b-4113-a3ff-b7e70d52c074 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:10.692773 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7d228bb4-3b8b-4113-a3ff-b7e70d52c074 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:10.693213 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7d228bb4-3b8b-4113-a3ff-b7e70d52c074 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:10.842081 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-7d228bb4-3b8b-4113-a3ff-b7e70d52c074 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:10.851888 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-7d228bb4-3b8b-4113-a3ff-b7e70d52c074 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1748 microversion: 2.1 time: 0.171542 Jun 23 13:44:10.852477 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 318/623] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:10 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1748 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:11.335818 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-468aa16f-63df-4ac3-856a-8e11ebb0dd5c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:11.336517 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-468aa16f-63df-4ac3-856a-8e11ebb0dd5c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:11.342834 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-468aa16f-63df-4ac3-856a-8e11ebb0dd5c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:11.343312 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-468aa16f-63df-4ac3-856a-8e11ebb0dd5c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:11.344097 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-468aa16f-63df-4ac3-856a-8e11ebb0dd5c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:11.344528 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-468aa16f-63df-4ac3-856a-8e11ebb0dd5c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:11.474940 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-468aa16f-63df-4ac3-856a-8e11ebb0dd5c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:11.482978 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-468aa16f-63df-4ac3-856a-8e11ebb0dd5c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:11.484596 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-468aa16f-63df-4ac3-856a-8e11ebb0dd5c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:11.485694 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-468aa16f-63df-4ac3-856a-8e11ebb0dd5c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1407 microversion: 2.20 time: 0.155257 Jun 23 13:44:11.486219 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 306/624] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:44:11 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:44:11.776573 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-aa6cc675-5d21-48d6-b43b-99a08fc96aa5 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:44:11.777433 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-aa6cc675-5d21-48d6-b43b-99a08fc96aa5 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:11.785723 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-aa6cc675-5d21-48d6-b43b-99a08fc96aa5 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:11.786176 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-aa6cc675-5d21-48d6-b43b-99a08fc96aa5 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:11.786944 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-aa6cc675-5d21-48d6-b43b-99a08fc96aa5 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:11.787392 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-aa6cc675-5d21-48d6-b43b-99a08fc96aa5 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:11.810139 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.objects.instance [None req-aa6cc675-5d21-48d6-b43b-99a08fc96aa5 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lazy-loading 'flavor' on Instance uuid 89a0e254-8280-4e56-80e6-525cca5dcac3 {{(pid=134667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:44:11.870392 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-ff79f799-50b1-4d53-804c-9ca579874b59 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:11.871006 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-ff79f799-50b1-4d53-804c-9ca579874b59 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:11.877960 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ff79f799-50b1-4d53-804c-9ca579874b59 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:11.878403 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ff79f799-50b1-4d53-804c-9ca579874b59 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:11.878571 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:44:11.879173 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ff79f799-50b1-4d53-804c-9ca579874b59 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:11.879703 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ff79f799-50b1-4d53-804c-9ca579874b59 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:11.888516 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-aa6cc675-5d21-48d6-b43b-99a08fc96aa5 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "POST /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3/action" status: 202 len: 0 microversion: 2.1 time: 0.118606 Jun 23 13:44:11.889208 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 319/625] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Jun 23 13:44:11 2022] POST /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 13:44:11.898499 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-86a3c9dd-d372-4b55-9b53-b1ebd8b19d6f tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:11.899140 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-86a3c9dd-d372-4b55-9b53-b1ebd8b19d6f tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:11.907064 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-86a3c9dd-d372-4b55-9b53-b1ebd8b19d6f tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:11.907643 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-86a3c9dd-d372-4b55-9b53-b1ebd8b19d6f tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:11.908378 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-86a3c9dd-d372-4b55-9b53-b1ebd8b19d6f tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:11.908859 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-86a3c9dd-d372-4b55-9b53-b1ebd8b19d6f tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:12.093092 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-ff79f799-50b1-4d53-804c-9ca579874b59 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:12.096944 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-86a3c9dd-d372-4b55-9b53-b1ebd8b19d6f tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:12.101604 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-ff79f799-50b1-4d53-804c-9ca579874b59 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1748 microversion: 2.1 time: 0.235121 Jun 23 13:44:12.102306 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 307/626] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:11 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1748 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:12.104784 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-86a3c9dd-d372-4b55-9b53-b1ebd8b19d6f tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1567 microversion: 2.1 time: 0.210626 Jun 23 13:44:12.105320 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 320/627] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:11 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:44:12.513536 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-78930e77-c607-4a35-8354-b235d76c82cd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:12.514539 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-78930e77-c607-4a35-8354-b235d76c82cd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:12.525128 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-78930e77-c607-4a35-8354-b235d76c82cd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:12.525867 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-78930e77-c607-4a35-8354-b235d76c82cd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:12.527115 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-78930e77-c607-4a35-8354-b235d76c82cd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:12.527896 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-78930e77-c607-4a35-8354-b235d76c82cd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:12.664518 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-78930e77-c607-4a35-8354-b235d76c82cd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:12.672601 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-78930e77-c607-4a35-8354-b235d76c82cd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:12.674091 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-78930e77-c607-4a35-8354-b235d76c82cd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:12.675220 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-78930e77-c607-4a35-8354-b235d76c82cd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1407 microversion: 2.20 time: 0.173274 Jun 23 13:44:12.675809 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 308/628] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:44:12 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:44:13.118393 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-599ab109-912d-4d7d-8ad2-6f4d95b3e795 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:13.119015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-599ab109-912d-4d7d-8ad2-6f4d95b3e795 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:13.122190 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-5b2c1486-b683-456c-9c77-e9a77c8f6dd5 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:13.123319 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-5b2c1486-b683-456c-9c77-e9a77c8f6dd5 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:13.125755 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-599ab109-912d-4d7d-8ad2-6f4d95b3e795 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:13.126195 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-599ab109-912d-4d7d-8ad2-6f4d95b3e795 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:13.126971 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-599ab109-912d-4d7d-8ad2-6f4d95b3e795 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:13.127437 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-599ab109-912d-4d7d-8ad2-6f4d95b3e795 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:13.129913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5b2c1486-b683-456c-9c77-e9a77c8f6dd5 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:13.130562 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5b2c1486-b683-456c-9c77-e9a77c8f6dd5 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:13.131360 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5b2c1486-b683-456c-9c77-e9a77c8f6dd5 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:13.131786 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5b2c1486-b683-456c-9c77-e9a77c8f6dd5 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:13.334969 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-5b2c1486-b683-456c-9c77-e9a77c8f6dd5 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:13.342995 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-599ab109-912d-4d7d-8ad2-6f4d95b3e795 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:13.344913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-5b2c1486-b683-456c-9c77-e9a77c8f6dd5 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1567 microversion: 2.1 time: 0.225700 Jun 23 13:44:13.345917 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 309/629] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:13 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1567 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:13.357749 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-599ab109-912d-4d7d-8ad2-6f4d95b3e795 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1748 microversion: 2.1 time: 0.243446 Jun 23 13:44:13.361748 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 321/630] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:13 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1748 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:13.698009 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-811514ad-66c5-4992-8b2b-0faad8b3eb93 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:13.699012 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-811514ad-66c5-4992-8b2b-0faad8b3eb93 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:13.707083 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-811514ad-66c5-4992-8b2b-0faad8b3eb93 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:13.707588 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-811514ad-66c5-4992-8b2b-0faad8b3eb93 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:13.708652 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-811514ad-66c5-4992-8b2b-0faad8b3eb93 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:13.709097 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-811514ad-66c5-4992-8b2b-0faad8b3eb93 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:13.842876 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-811514ad-66c5-4992-8b2b-0faad8b3eb93 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:13.854569 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-811514ad-66c5-4992-8b2b-0faad8b3eb93 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:13.856904 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-811514ad-66c5-4992-8b2b-0faad8b3eb93 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:13.858706 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-811514ad-66c5-4992-8b2b-0faad8b3eb93 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1407 microversion: 2.20 time: 0.167649 Jun 23 13:44:13.859554 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 310/631] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:44:13 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:44:14.366160 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-46a2e787-3043-4eab-9cdf-ea6642f40910 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:14.367006 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-46a2e787-3043-4eab-9cdf-ea6642f40910 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:14.377751 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-713bf84e-8e61-4255-83e5-43e0e7e1e6f2 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:14.378496 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-46a2e787-3043-4eab-9cdf-ea6642f40910 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:14.378680 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-46a2e787-3043-4eab-9cdf-ea6642f40910 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:14.378841 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-713bf84e-8e61-4255-83e5-43e0e7e1e6f2 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:14.379901 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-46a2e787-3043-4eab-9cdf-ea6642f40910 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:14.380644 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-46a2e787-3043-4eab-9cdf-ea6642f40910 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:14.387856 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:44:14.390690 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-713bf84e-8e61-4255-83e5-43e0e7e1e6f2 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:14.391184 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-713bf84e-8e61-4255-83e5-43e0e7e1e6f2 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:14.392074 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-713bf84e-8e61-4255-83e5-43e0e7e1e6f2 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:14.392510 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-713bf84e-8e61-4255-83e5-43e0e7e1e6f2 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:14.422790 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell0:SELECT=2 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:44:14.437858 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell0:SELECT=10 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:44:14.575478 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell0:SELECT=2 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:44:14.588999 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-46a2e787-3043-4eab-9cdf-ea6642f40910 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:14.596950 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-46a2e787-3043-4eab-9cdf-ea6642f40910 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1567 microversion: 2.1 time: 0.237335 Jun 23 13:44:14.597513 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 322/632] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:14 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1567 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:14.609214 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-713bf84e-8e61-4255-83e5-43e0e7e1e6f2 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:14.617371 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-713bf84e-8e61-4255-83e5-43e0e7e1e6f2 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1748 microversion: 2.1 time: 0.245844 Jun 23 13:44:14.617870 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 311/633] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:14 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1748 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:14.877253 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-fe8c0cf1-a0de-4d64-8269-5298a6b52ebb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:14.877903 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-fe8c0cf1-a0de-4d64-8269-5298a6b52ebb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:14.885689 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fe8c0cf1-a0de-4d64-8269-5298a6b52ebb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:14.886144 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fe8c0cf1-a0de-4d64-8269-5298a6b52ebb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:14.886911 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fe8c0cf1-a0de-4d64-8269-5298a6b52ebb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:14.887360 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fe8c0cf1-a0de-4d64-8269-5298a6b52ebb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:15.076655 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-fe8c0cf1-a0de-4d64-8269-5298a6b52ebb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:15.085097 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-fe8c0cf1-a0de-4d64-8269-5298a6b52ebb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:15.086591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-fe8c0cf1-a0de-4d64-8269-5298a6b52ebb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:15.087743 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-fe8c0cf1-a0de-4d64-8269-5298a6b52ebb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1407 microversion: 2.20 time: 0.214687 Jun 23 13:44:15.088275 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 323/634] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:44:14 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:44:15.615905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-2528565b-436f-4567-b500-abcc819e0661 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:15.616508 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-2528565b-436f-4567-b500-abcc819e0661 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:15.622692 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2528565b-436f-4567-b500-abcc819e0661 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:15.623146 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2528565b-436f-4567-b500-abcc819e0661 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:15.623936 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2528565b-436f-4567-b500-abcc819e0661 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:15.624368 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2528565b-436f-4567-b500-abcc819e0661 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:15.633920 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-17a0311e-1aa6-49ce-ac2b-dbf89569a450 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:15.635146 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-17a0311e-1aa6-49ce-ac2b-dbf89569a450 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:15.641930 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-17a0311e-1aa6-49ce-ac2b-dbf89569a450 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:15.642372 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-17a0311e-1aa6-49ce-ac2b-dbf89569a450 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:15.643128 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-17a0311e-1aa6-49ce-ac2b-dbf89569a450 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:15.643573 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-17a0311e-1aa6-49ce-ac2b-dbf89569a450 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:15.870030 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-17a0311e-1aa6-49ce-ac2b-dbf89569a450 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:15.873111 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-2528565b-436f-4567-b500-abcc819e0661 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:15.880742 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-2528565b-436f-4567-b500-abcc819e0661 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1567 microversion: 2.1 time: 0.269077 Jun 23 13:44:15.881292 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 312/635] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:15 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1567 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:15.883727 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-17a0311e-1aa6-49ce-ac2b-dbf89569a450 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1753 microversion: 2.1 time: 0.253520 Jun 23 13:44:15.884322 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 324/636] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:15 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1753 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:16.109786 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-0e0e56aa-2cb1-4b6e-a27b-a9834657126e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:16.110404 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-0e0e56aa-2cb1-4b6e-a27b-a9834657126e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:16.116974 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0e0e56aa-2cb1-4b6e-a27b-a9834657126e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:16.117419 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0e0e56aa-2cb1-4b6e-a27b-a9834657126e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:16.118173 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0e0e56aa-2cb1-4b6e-a27b-a9834657126e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:16.118607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0e0e56aa-2cb1-4b6e-a27b-a9834657126e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:16.247777 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-0e0e56aa-2cb1-4b6e-a27b-a9834657126e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:16.256504 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-0e0e56aa-2cb1-4b6e-a27b-a9834657126e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:16.257996 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-0e0e56aa-2cb1-4b6e-a27b-a9834657126e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:16.259109 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-0e0e56aa-2cb1-4b6e-a27b-a9834657126e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1407 microversion: 2.20 time: 0.155709 Jun 23 13:44:16.259704 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 313/637] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:44:16 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:44:16.831407 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-a1f4a118-7306-4149-98ba-964c81aaa500 req-6efc6ba7-d714-4fb4-9e3f-065aac9620c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a602a74c-fbf6-4ed0-85c6-f1778d879da7", "name": "network-vif-plugged", "status": "completed", "tag": "2a2fc7e3-801b-47fb-9626-bb5520448495"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:44:16.841374 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-a1f4a118-7306-4149-98ba-964c81aaa500 req-6efc6ba7-d714-4fb4-9e3f-065aac9620c9 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:16.841769 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-a1f4a118-7306-4149-98ba-964c81aaa500 req-6efc6ba7-d714-4fb4-9e3f-065aac9620c9 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:16.854199 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-a1f4a118-7306-4149-98ba-964c81aaa500 req-6efc6ba7-d714-4fb4-9e3f-065aac9620c9 service nova] Creating event network-vif-plugged:2a2fc7e3-801b-47fb-9626-bb5520448495 for instance a602a74c-fbf6-4ed0-85c6-f1778d879da7 on hv-cinder-81558 Jun 23 13:44:16.864241 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-a1f4a118-7306-4149-98ba-964c81aaa500 req-6efc6ba7-d714-4fb4-9e3f-065aac9620c9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031855 Jun 23 13:44:16.864241 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 325/638] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:44:16.898789 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-31badecd-ba91-4325-a9e4-398e4864e183 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:16.899397 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-31badecd-ba91-4325-a9e4-398e4864e183 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:16.905391 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-b18c9195-530b-470f-9b6b-cd589485741e tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:16.906356 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-b18c9195-530b-470f-9b6b-cd589485741e tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:16.910600 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-31badecd-ba91-4325-a9e4-398e4864e183 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:16.911052 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-31badecd-ba91-4325-a9e4-398e4864e183 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:16.912034 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-31badecd-ba91-4325-a9e4-398e4864e183 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:16.912469 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-31badecd-ba91-4325-a9e4-398e4864e183 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:16.931528 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b18c9195-530b-470f-9b6b-cd589485741e tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:16.931944 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b18c9195-530b-470f-9b6b-cd589485741e tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:16.932751 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b18c9195-530b-470f-9b6b-cd589485741e tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:16.933193 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b18c9195-530b-470f-9b6b-cd589485741e tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:17.128493 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-31badecd-ba91-4325-a9e4-398e4864e183 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:17.136604 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-31badecd-ba91-4325-a9e4-398e4864e183 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1567 microversion: 2.1 time: 0.242351 Jun 23 13:44:17.137184 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 314/639] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:16 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1567 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:17.158265 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-b18c9195-530b-470f-9b6b-cd589485741e tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:17.166703 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-b18c9195-530b-470f-9b6b-cd589485741e tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1753 microversion: 2.1 time: 0.265828 Jun 23 13:44:17.167419 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 326/640] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:16 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1753 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:17.278057 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-4f699595-6cb5-4536-bccd-d9a4ec8a7bd6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:17.278734 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-4f699595-6cb5-4536-bccd-d9a4ec8a7bd6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:17.285938 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4f699595-6cb5-4536-bccd-d9a4ec8a7bd6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:17.286546 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4f699595-6cb5-4536-bccd-d9a4ec8a7bd6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:17.287363 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4f699595-6cb5-4536-bccd-d9a4ec8a7bd6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:17.287907 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4f699595-6cb5-4536-bccd-d9a4ec8a7bd6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:17.435391 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-4f699595-6cb5-4536-bccd-d9a4ec8a7bd6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:17.447927 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-4f699595-6cb5-4536-bccd-d9a4ec8a7bd6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:17.452637 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-4f699595-6cb5-4536-bccd-d9a4ec8a7bd6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:17.453749 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-4f699595-6cb5-4536-bccd-d9a4ec8a7bd6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1407 microversion: 2.20 time: 0.180528 Jun 23 13:44:17.454311 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 315/641] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:44:17 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:44:18.153579 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-e2a9a665-6534-4f5e-819b-104a3c025815 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:18.154215 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-e2a9a665-6534-4f5e-819b-104a3c025815 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:18.161142 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e2a9a665-6534-4f5e-819b-104a3c025815 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:18.161599 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e2a9a665-6534-4f5e-819b-104a3c025815 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:18.162521 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e2a9a665-6534-4f5e-819b-104a3c025815 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:18.162966 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e2a9a665-6534-4f5e-819b-104a3c025815 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:18.184393 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-5d430171-10f7-40e1-8eb9-2dc7cefd4a58 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:18.185073 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-5d430171-10f7-40e1-8eb9-2dc7cefd4a58 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:18.192097 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5d430171-10f7-40e1-8eb9-2dc7cefd4a58 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:18.192618 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5d430171-10f7-40e1-8eb9-2dc7cefd4a58 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:18.193386 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5d430171-10f7-40e1-8eb9-2dc7cefd4a58 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:18.193899 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5d430171-10f7-40e1-8eb9-2dc7cefd4a58 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:18.345767 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-e2a9a665-6534-4f5e-819b-104a3c025815 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:18.353451 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-e2a9a665-6534-4f5e-819b-104a3c025815 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1567 microversion: 2.1 time: 0.203818 Jun 23 13:44:18.354020 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 327/642] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:18 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1567 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:18.386819 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-5d430171-10f7-40e1-8eb9-2dc7cefd4a58 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:18.397540 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-5d430171-10f7-40e1-8eb9-2dc7cefd4a58 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1753 microversion: 2.1 time: 0.216809 Jun 23 13:44:18.398902 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 316/643] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:18 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1753 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:18.472862 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-089fbefd-37ca-49e2-91dc-774f77b4441a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:18.473472 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-089fbefd-37ca-49e2-91dc-774f77b4441a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:18.479851 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-089fbefd-37ca-49e2-91dc-774f77b4441a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:18.480307 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-089fbefd-37ca-49e2-91dc-774f77b4441a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:18.481071 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-089fbefd-37ca-49e2-91dc-774f77b4441a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:18.481504 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-089fbefd-37ca-49e2-91dc-774f77b4441a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:18.631171 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-089fbefd-37ca-49e2-91dc-774f77b4441a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:18.639621 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-089fbefd-37ca-49e2-91dc-774f77b4441a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:18.641134 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-089fbefd-37ca-49e2-91dc-774f77b4441a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:18.642257 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-089fbefd-37ca-49e2-91dc-774f77b4441a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1407 microversion: 2.20 time: 0.173479 Jun 23 13:44:18.642821 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 328/644] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:44:18 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:44:19.370968 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-cd2942d1-e38d-4d68-a36c-3915463ba4ca tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:19.371553 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-cd2942d1-e38d-4d68-a36c-3915463ba4ca tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:19.378489 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-cd2942d1-e38d-4d68-a36c-3915463ba4ca tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:19.378946 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-cd2942d1-e38d-4d68-a36c-3915463ba4ca tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:19.379754 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-cd2942d1-e38d-4d68-a36c-3915463ba4ca tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:19.380194 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-cd2942d1-e38d-4d68-a36c-3915463ba4ca tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:19.415061 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-b7cc35ed-39df-4511-ac5f-f86ad830018f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:19.415721 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-b7cc35ed-39df-4511-ac5f-f86ad830018f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:19.423219 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b7cc35ed-39df-4511-ac5f-f86ad830018f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:19.423779 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b7cc35ed-39df-4511-ac5f-f86ad830018f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:19.424872 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b7cc35ed-39df-4511-ac5f-f86ad830018f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:19.425498 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b7cc35ed-39df-4511-ac5f-f86ad830018f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:19.569201 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-cd2942d1-e38d-4d68-a36c-3915463ba4ca tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:19.577372 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-cd2942d1-e38d-4d68-a36c-3915463ba4ca tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1567 microversion: 2.1 time: 0.210298 Jun 23 13:44:19.578001 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 317/645] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:19 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:19.612208 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-b7cc35ed-39df-4511-ac5f-f86ad830018f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:19.622183 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-b7cc35ed-39df-4511-ac5f-f86ad830018f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1753 microversion: 2.1 time: 0.210755 Jun 23 13:44:19.622858 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 329/646] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:19 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1753 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:19.660707 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-8a5896af-7c9e-425c-b3c1-01eca1011553 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:19.661349 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-8a5896af-7c9e-425c-b3c1-01eca1011553 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:19.667322 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8a5896af-7c9e-425c-b3c1-01eca1011553 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:19.667797 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8a5896af-7c9e-425c-b3c1-01eca1011553 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:19.668556 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8a5896af-7c9e-425c-b3c1-01eca1011553 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:19.668984 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8a5896af-7c9e-425c-b3c1-01eca1011553 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:19.799996 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-8a5896af-7c9e-425c-b3c1-01eca1011553 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:19.808404 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-8a5896af-7c9e-425c-b3c1-01eca1011553 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:19.809897 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-8a5896af-7c9e-425c-b3c1-01eca1011553 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:19.811053 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-8a5896af-7c9e-425c-b3c1-01eca1011553 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1598 microversion: 2.20 time: 0.154364 Jun 23 13:44:19.811725 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 318/647] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:44:19 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:44:19.834569 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-ef69dfce-5e37-4679-b167-0e2e48ebb479 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:19.835067 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-ef69dfce-5e37-4679-b167-0e2e48ebb479 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:19.841688 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ef69dfce-5e37-4679-b167-0e2e48ebb479 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:19.842141 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ef69dfce-5e37-4679-b167-0e2e48ebb479 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:19.842906 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ef69dfce-5e37-4679-b167-0e2e48ebb479 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:19.843365 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ef69dfce-5e37-4679-b167-0e2e48ebb479 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:19.918877 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-ef69dfce-5e37-4679-b167-0e2e48ebb479 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.088464 Jun 23 13:44:19.919507 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 330/648] 10.222.0.26 () {60 vars in 1315 bytes} [Thu Jun 23 13:44:19 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 13:44:20.596813 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-612e7da9-75e4-4ebb-bbce-492c2e911e09 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:20.598050 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-612e7da9-75e4-4ebb-bbce-492c2e911e09 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:20.605099 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-612e7da9-75e4-4ebb-bbce-492c2e911e09 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:20.605513 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-612e7da9-75e4-4ebb-bbce-492c2e911e09 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:20.606276 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-612e7da9-75e4-4ebb-bbce-492c2e911e09 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:20.606704 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-612e7da9-75e4-4ebb-bbce-492c2e911e09 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:20.640049 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-e793b417-c0c9-4f85-89e2-5dbc86895b32 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:20.641601 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-e793b417-c0c9-4f85-89e2-5dbc86895b32 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:20.648236 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e793b417-c0c9-4f85-89e2-5dbc86895b32 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:20.648799 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e793b417-c0c9-4f85-89e2-5dbc86895b32 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:20.649797 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e793b417-c0c9-4f85-89e2-5dbc86895b32 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:20.650311 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e793b417-c0c9-4f85-89e2-5dbc86895b32 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:20.787744 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-612e7da9-75e4-4ebb-bbce-492c2e911e09 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:20.797320 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-612e7da9-75e4-4ebb-bbce-492c2e911e09 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1567 microversion: 2.1 time: 0.206264 Jun 23 13:44:20.798002 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 319/649] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:20 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:20.842752 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-e793b417-c0c9-4f85-89e2-5dbc86895b32 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:20.852687 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-e793b417-c0c9-4f85-89e2-5dbc86895b32 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1753 microversion: 2.1 time: 0.217110 Jun 23 13:44:20.863718 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 331/650] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:20 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1753 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:20.866434 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-2e635cd7-e6b3-4a48-8abe-c8c0d8778181 req-5ea050b0-0871-43ef-99b3-272d5c23056a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a602a74c-fbf6-4ed0-85c6-f1778d879da7", "tag": "2a2fc7e3-801b-47fb-9626-bb5520448495"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:44:20.874654 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-2e635cd7-e6b3-4a48-8abe-c8c0d8778181 req-5ea050b0-0871-43ef-99b3-272d5c23056a service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:20.875100 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-2e635cd7-e6b3-4a48-8abe-c8c0d8778181 req-5ea050b0-0871-43ef-99b3-272d5c23056a service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:20.886094 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-2e635cd7-e6b3-4a48-8abe-c8c0d8778181 req-5ea050b0-0871-43ef-99b3-272d5c23056a service nova] Creating event network-changed:2a2fc7e3-801b-47fb-9626-bb5520448495 for instance a602a74c-fbf6-4ed0-85c6-f1778d879da7 on hv-cinder-81558 Jun 23 13:44:20.891292 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-2e635cd7-e6b3-4a48-8abe-c8c0d8778181 req-5ea050b0-0871-43ef-99b3-272d5c23056a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028547 Jun 23 13:44:20.891922 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 320/651] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:44:21.814504 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-073ad832-285f-49dc-b24f-69cc26bf25bb tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:21.815231 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-073ad832-285f-49dc-b24f-69cc26bf25bb tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:21.824199 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-073ad832-285f-49dc-b24f-69cc26bf25bb tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:21.824721 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-073ad832-285f-49dc-b24f-69cc26bf25bb tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:21.825698 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-073ad832-285f-49dc-b24f-69cc26bf25bb tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:21.826138 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-073ad832-285f-49dc-b24f-69cc26bf25bb tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:21.871357 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-8925a9ea-9437-4d9f-97ed-b372ce314ef5 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:21.872330 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-8925a9ea-9437-4d9f-97ed-b372ce314ef5 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:21.878724 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8925a9ea-9437-4d9f-97ed-b372ce314ef5 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:21.879178 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8925a9ea-9437-4d9f-97ed-b372ce314ef5 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:21.880162 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8925a9ea-9437-4d9f-97ed-b372ce314ef5 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:21.880602 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8925a9ea-9437-4d9f-97ed-b372ce314ef5 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:22.017736 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-073ad832-285f-49dc-b24f-69cc26bf25bb tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:22.026298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-073ad832-285f-49dc-b24f-69cc26bf25bb tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1567 microversion: 2.1 time: 0.215622 Jun 23 13:44:22.026905 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 332/652] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:21 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1567 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:22.062129 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-8925a9ea-9437-4d9f-97ed-b372ce314ef5 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:22.069999 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-8925a9ea-9437-4d9f-97ed-b372ce314ef5 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1753 microversion: 2.1 time: 0.203629 Jun 23 13:44:22.070558 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 321/653] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:21 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1753 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:23.042759 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-45729e63-2f34-4d4d-a851-4b20fc332888 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:23.043438 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-45729e63-2f34-4d4d-a851-4b20fc332888 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:23.050158 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-45729e63-2f34-4d4d-a851-4b20fc332888 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:23.050645 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-45729e63-2f34-4d4d-a851-4b20fc332888 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:23.051501 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-45729e63-2f34-4d4d-a851-4b20fc332888 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:23.051934 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-45729e63-2f34-4d4d-a851-4b20fc332888 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:23.087272 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-d977e0dd-186d-48e0-8dff-2d04fc010031 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:23.087896 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-d977e0dd-186d-48e0-8dff-2d04fc010031 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:23.094817 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d977e0dd-186d-48e0-8dff-2d04fc010031 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:23.095304 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d977e0dd-186d-48e0-8dff-2d04fc010031 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:23.096188 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d977e0dd-186d-48e0-8dff-2d04fc010031 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:23.096626 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d977e0dd-186d-48e0-8dff-2d04fc010031 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:23.239577 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-45729e63-2f34-4d4d-a851-4b20fc332888 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:23.247709 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-45729e63-2f34-4d4d-a851-4b20fc332888 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1567 microversion: 2.1 time: 0.209035 Jun 23 13:44:23.248385 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 333/654] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:23 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1567 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:23.278962 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-d977e0dd-186d-48e0-8dff-2d04fc010031 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:23.282605 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:44:23.288106 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-d977e0dd-186d-48e0-8dff-2d04fc010031 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1753 microversion: 2.1 time: 0.204787 Jun 23 13:44:23.288676 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 322/655] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:23 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1753 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:24.265857 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-03bb1be2-5c7b-4478-be53-479a09a355c0 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:24.266455 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-03bb1be2-5c7b-4478-be53-479a09a355c0 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:24.272748 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-03bb1be2-5c7b-4478-be53-479a09a355c0 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:24.273194 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-03bb1be2-5c7b-4478-be53-479a09a355c0 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:24.273946 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-03bb1be2-5c7b-4478-be53-479a09a355c0 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:24.274388 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-03bb1be2-5c7b-4478-be53-479a09a355c0 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:24.305648 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-babeb9ca-a6d6-4fe8-bd6d-88f1cbc48298 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:24.306307 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-babeb9ca-a6d6-4fe8-bd6d-88f1cbc48298 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:24.314522 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-babeb9ca-a6d6-4fe8-bd6d-88f1cbc48298 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:24.314968 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-babeb9ca-a6d6-4fe8-bd6d-88f1cbc48298 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:24.315764 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-babeb9ca-a6d6-4fe8-bd6d-88f1cbc48298 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:24.316192 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-babeb9ca-a6d6-4fe8-bd6d-88f1cbc48298 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:24.459225 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-03bb1be2-5c7b-4478-be53-479a09a355c0 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:24.467152 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-03bb1be2-5c7b-4478-be53-479a09a355c0 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1567 microversion: 2.1 time: 0.205312 Jun 23 13:44:24.467766 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 334/656] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:24 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:24.496863 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-babeb9ca-a6d6-4fe8-bd6d-88f1cbc48298 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:24.505260 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-babeb9ca-a6d6-4fe8-bd6d-88f1cbc48298 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1753 microversion: 2.1 time: 0.203784 Jun 23 13:44:24.505831 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 323/657] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:24 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1753 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:25.485452 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-308b9f1a-c5de-4a9a-8be4-acc4b02886a0 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:25.486241 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-308b9f1a-c5de-4a9a-8be4-acc4b02886a0 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:25.492653 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-308b9f1a-c5de-4a9a-8be4-acc4b02886a0 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:25.493179 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-308b9f1a-c5de-4a9a-8be4-acc4b02886a0 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:25.494022 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-308b9f1a-c5de-4a9a-8be4-acc4b02886a0 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:25.494461 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-308b9f1a-c5de-4a9a-8be4-acc4b02886a0 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:25.525937 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-38cef73a-725a-4e2b-b2fd-88f9953e82e8 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:25.527232 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-38cef73a-725a-4e2b-b2fd-88f9953e82e8 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:25.535069 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-38cef73a-725a-4e2b-b2fd-88f9953e82e8 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:25.535541 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-38cef73a-725a-4e2b-b2fd-88f9953e82e8 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:25.536517 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-38cef73a-725a-4e2b-b2fd-88f9953e82e8 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:25.536955 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-38cef73a-725a-4e2b-b2fd-88f9953e82e8 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:25.718146 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-308b9f1a-c5de-4a9a-8be4-acc4b02886a0 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:25.726981 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-308b9f1a-c5de-4a9a-8be4-acc4b02886a0 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1567 microversion: 2.1 time: 0.246421 Jun 23 13:44:25.727854 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 335/658] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:25 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:25.754199 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-38cef73a-725a-4e2b-b2fd-88f9953e82e8 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:25.762394 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-38cef73a-725a-4e2b-b2fd-88f9953e82e8 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1753 microversion: 2.1 time: 0.243396 Jun 23 13:44:25.762969 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 324/659] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:25 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1753 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:44:26.745196 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-baa2711e-a41a-4e41-b772-0f19a66a9d08 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:26.745862 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-baa2711e-a41a-4e41-b772-0f19a66a9d08 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:26.752945 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-baa2711e-a41a-4e41-b772-0f19a66a9d08 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:26.753393 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-baa2711e-a41a-4e41-b772-0f19a66a9d08 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:26.754147 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-baa2711e-a41a-4e41-b772-0f19a66a9d08 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:26.754574 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-baa2711e-a41a-4e41-b772-0f19a66a9d08 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:26.780499 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-d4efff97-14d6-4f1b-9680-25eaca73a8ba tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:26.781102 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-d4efff97-14d6-4f1b-9680-25eaca73a8ba tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:26.787545 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d4efff97-14d6-4f1b-9680-25eaca73a8ba tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:26.788025 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d4efff97-14d6-4f1b-9680-25eaca73a8ba tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:26.788814 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d4efff97-14d6-4f1b-9680-25eaca73a8ba tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:26.789252 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d4efff97-14d6-4f1b-9680-25eaca73a8ba tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:26.951884 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-baa2711e-a41a-4e41-b772-0f19a66a9d08 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:26.961536 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-baa2711e-a41a-4e41-b772-0f19a66a9d08 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1567 microversion: 2.1 time: 0.221043 Jun 23 13:44:26.962292 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 336/660] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:26 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:26.990460 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-d4efff97-14d6-4f1b-9680-25eaca73a8ba tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:26.999904 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-d4efff97-14d6-4f1b-9680-25eaca73a8ba tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1753 microversion: 2.1 time: 0.223506 Jun 23 13:44:27.000483 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 325/661] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:26 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1753 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:27.983167 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-eecb8aba-c078-4cf9-aaa2-df8ea19195c4 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:27.984261 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-eecb8aba-c078-4cf9-aaa2-df8ea19195c4 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:27.991532 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-eecb8aba-c078-4cf9-aaa2-df8ea19195c4 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:27.991982 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-eecb8aba-c078-4cf9-aaa2-df8ea19195c4 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:27.992736 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-eecb8aba-c078-4cf9-aaa2-df8ea19195c4 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:27.993153 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-eecb8aba-c078-4cf9-aaa2-df8ea19195c4 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:28.007745 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=100 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:44:28.017558 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-4e603e03-cfe9-442f-9676-cc3163fd48e0 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:28.018269 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-4e603e03-cfe9-442f-9676-cc3163fd48e0 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:28.025141 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4e603e03-cfe9-442f-9676-cc3163fd48e0 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:28.025690 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4e603e03-cfe9-442f-9676-cc3163fd48e0 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:28.026456 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4e603e03-cfe9-442f-9676-cc3163fd48e0 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:28.026893 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4e603e03-cfe9-442f-9676-cc3163fd48e0 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:28.379270 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-eecb8aba-c078-4cf9-aaa2-df8ea19195c4 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:28.387204 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-eecb8aba-c078-4cf9-aaa2-df8ea19195c4 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1567 microversion: 2.1 time: 0.410603 Jun 23 13:44:28.387812 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 337/662] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:27 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1567 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:28.418387 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-4e603e03-cfe9-442f-9676-cc3163fd48e0 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:28.426604 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-4e603e03-cfe9-442f-9676-cc3163fd48e0 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1753 microversion: 2.1 time: 0.413263 Jun 23 13:44:28.427169 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 326/663] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:28 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1753 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:29.408644 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-e6db1f79-abcd-4faf-9b0a-97bfeb518ce4 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:29.409643 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-e6db1f79-abcd-4faf-9b0a-97bfeb518ce4 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:29.421132 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e6db1f79-abcd-4faf-9b0a-97bfeb518ce4 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:29.421895 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e6db1f79-abcd-4faf-9b0a-97bfeb518ce4 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:29.422946 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e6db1f79-abcd-4faf-9b0a-97bfeb518ce4 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:29.423380 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e6db1f79-abcd-4faf-9b0a-97bfeb518ce4 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:29.443889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-dc9e2ee3-77cb-4cb6-8129-869da30af289 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:29.444500 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-dc9e2ee3-77cb-4cb6-8129-869da30af289 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:29.451442 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-dc9e2ee3-77cb-4cb6-8129-869da30af289 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:29.451943 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-dc9e2ee3-77cb-4cb6-8129-869da30af289 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:29.452705 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-dc9e2ee3-77cb-4cb6-8129-869da30af289 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:29.453136 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-dc9e2ee3-77cb-4cb6-8129-869da30af289 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:29.606822 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-e6db1f79-abcd-4faf-9b0a-97bfeb518ce4 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:29.614760 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-e6db1f79-abcd-4faf-9b0a-97bfeb518ce4 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1567 microversion: 2.1 time: 0.212811 Jun 23 13:44:29.615354 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 338/664] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:29 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1567 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:29.640648 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-dc9e2ee3-77cb-4cb6-8129-869da30af289 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:29.648895 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-dc9e2ee3-77cb-4cb6-8129-869da30af289 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1753 microversion: 2.1 time: 0.208879 Jun 23 13:44:29.649473 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 327/665] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:29 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1753 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:30.635026 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-bab620d3-6508-4a48-9ca6-84e08a9a0fd8 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:30.635624 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-bab620d3-6508-4a48-9ca6-84e08a9a0fd8 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:30.644298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bab620d3-6508-4a48-9ca6-84e08a9a0fd8 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:30.644794 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bab620d3-6508-4a48-9ca6-84e08a9a0fd8 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:30.645560 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bab620d3-6508-4a48-9ca6-84e08a9a0fd8 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:30.645996 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bab620d3-6508-4a48-9ca6-84e08a9a0fd8 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:30.666181 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c01e25bb-e295-4932-8279-e1c5e0ec7021 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:30.666786 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-c01e25bb-e295-4932-8279-e1c5e0ec7021 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:30.673680 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c01e25bb-e295-4932-8279-e1c5e0ec7021 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:30.674105 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c01e25bb-e295-4932-8279-e1c5e0ec7021 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:30.674906 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c01e25bb-e295-4932-8279-e1c5e0ec7021 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:30.675415 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c01e25bb-e295-4932-8279-e1c5e0ec7021 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:30.850567 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-bab620d3-6508-4a48-9ca6-84e08a9a0fd8 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:30.858501 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-bab620d3-6508-4a48-9ca6-84e08a9a0fd8 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1567 microversion: 2.1 time: 0.229791 Jun 23 13:44:30.859073 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 339/666] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:30 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1567 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:30.865784 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-c01e25bb-e295-4932-8279-e1c5e0ec7021 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:30.876033 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-c01e25bb-e295-4932-8279-e1c5e0ec7021 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1753 microversion: 2.1 time: 0.213393 Jun 23 13:44:30.876789 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 328/667] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:30 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1753 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:31.880307 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-93e0e8fe-c179-4d04-97cc-a1e027e6a574 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:31.881127 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-93e0e8fe-c179-4d04-97cc-a1e027e6a574 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:31.892598 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-93e0e8fe-c179-4d04-97cc-a1e027e6a574 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:31.893345 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-93e0e8fe-c179-4d04-97cc-a1e027e6a574 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:31.894595 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-93e0e8fe-c179-4d04-97cc-a1e027e6a574 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:31.895306 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-93e0e8fe-c179-4d04-97cc-a1e027e6a574 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:31.897056 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-a8460d89-a32d-4681-b47e-ce25c45110cf tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:31.898126 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-a8460d89-a32d-4681-b47e-ce25c45110cf tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:31.908179 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a8460d89-a32d-4681-b47e-ce25c45110cf tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:31.908658 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a8460d89-a32d-4681-b47e-ce25c45110cf tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:31.909508 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a8460d89-a32d-4681-b47e-ce25c45110cf tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:31.909895 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a8460d89-a32d-4681-b47e-ce25c45110cf tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:32.092800 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-93e0e8fe-c179-4d04-97cc-a1e027e6a574 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:32.100802 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-93e0e8fe-c179-4d04-97cc-a1e027e6a574 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1567 microversion: 2.1 time: 0.227441 Jun 23 13:44:32.101417 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 340/668] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:31 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1567 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:32.118072 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-a8460d89-a32d-4681-b47e-ce25c45110cf tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:32.126764 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-a8460d89-a32d-4681-b47e-ce25c45110cf tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1753 microversion: 2.1 time: 0.236175 Jun 23 13:44:32.127374 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 329/669] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:31 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1753 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:33.118181 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-dfc46460-d0ee-4773-9538-d8c5c9b3bdf8 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:33.118887 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-dfc46460-d0ee-4773-9538-d8c5c9b3bdf8 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:33.125401 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-dfc46460-d0ee-4773-9538-d8c5c9b3bdf8 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:33.125844 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-dfc46460-d0ee-4773-9538-d8c5c9b3bdf8 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:33.126593 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-dfc46460-d0ee-4773-9538-d8c5c9b3bdf8 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:33.127020 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-dfc46460-d0ee-4773-9538-d8c5c9b3bdf8 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:33.144560 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-4453c969-7faa-4293-b0db-942cc9f6717a tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:33.145904 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-4453c969-7faa-4293-b0db-942cc9f6717a tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:33.153408 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4453c969-7faa-4293-b0db-942cc9f6717a tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:33.154198 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4453c969-7faa-4293-b0db-942cc9f6717a tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:33.155203 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4453c969-7faa-4293-b0db-942cc9f6717a tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:33.155846 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4453c969-7faa-4293-b0db-942cc9f6717a tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:33.312720 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-dfc46460-d0ee-4773-9538-d8c5c9b3bdf8 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:33.320661 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-dfc46460-d0ee-4773-9538-d8c5c9b3bdf8 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1567 microversion: 2.1 time: 0.206376 Jun 23 13:44:33.321321 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 341/670] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:33 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:33.354317 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-4453c969-7faa-4293-b0db-942cc9f6717a tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:33.362742 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-4453c969-7faa-4293-b0db-942cc9f6717a tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1756 microversion: 2.1 time: 0.222468 Jun 23 13:44:33.363313 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 330/671] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:33 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1756 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:34.337810 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-8d869523-9eb1-42da-9b7b-75432574f846 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:34.338400 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-8d869523-9eb1-42da-9b7b-75432574f846 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:34.345168 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8d869523-9eb1-42da-9b7b-75432574f846 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:34.345633 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8d869523-9eb1-42da-9b7b-75432574f846 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:34.346389 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8d869523-9eb1-42da-9b7b-75432574f846 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:34.346815 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8d869523-9eb1-42da-9b7b-75432574f846 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:34.476223 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-8d869523-9eb1-42da-9b7b-75432574f846 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:34.483793 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-8d869523-9eb1-42da-9b7b-75432574f846 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1508 microversion: 2.1 time: 0.149832 Jun 23 13:44:34.484375 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 331/672] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:34 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:34.499898 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-3a73ddac-11db-46a9-b7b2-4bcb2a98583b tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:44:34.500515 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-3a73ddac-11db-46a9-b7b2-4bcb2a98583b tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:34.506689 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3a73ddac-11db-46a9-b7b2-4bcb2a98583b tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:34.507139 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3a73ddac-11db-46a9-b7b2-4bcb2a98583b tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:34.507985 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3a73ddac-11db-46a9-b7b2-4bcb2a98583b tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:34.508441 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3a73ddac-11db-46a9-b7b2-4bcb2a98583b tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:34.539717 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-e0cc862a-2bfd-48db-b541-07f22aa651a9 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:34.540257 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-e0cc862a-2bfd-48db-b541-07f22aa651a9 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:34.546680 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e0cc862a-2bfd-48db-b541-07f22aa651a9 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:34.547247 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e0cc862a-2bfd-48db-b541-07f22aa651a9 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:34.548041 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e0cc862a-2bfd-48db-b541-07f22aa651a9 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:34.548466 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e0cc862a-2bfd-48db-b541-07f22aa651a9 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:34.571122 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-e0cc862a-2bfd-48db-b541-07f22aa651a9 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528/ips" status: 200 len: 149 microversion: 2.1 time: 0.269406 Jun 23 13:44:34.571883 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 342/673] 10.222.0.26 () {58 vars in 1247 bytes} [Thu Jun 23 13:44:34 2022] GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528/ips => generated 149 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:44:34.701172 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-3a73ddac-11db-46a9-b7b2-4bcb2a98583b tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "POST /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3/action" status: 202 len: 0 microversion: 2.1 time: 0.205187 Jun 23 13:44:34.701957 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 332/674] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Jun 23 13:44:34 2022] POST /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 13:44:34.711855 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-00b3d24d-a23b-48c0-ac41-0732e6f5f743 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:34.712538 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-00b3d24d-a23b-48c0-ac41-0732e6f5f743 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:34.718801 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-00b3d24d-a23b-48c0-ac41-0732e6f5f743 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:34.719564 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-00b3d24d-a23b-48c0-ac41-0732e6f5f743 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:34.720692 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-00b3d24d-a23b-48c0-ac41-0732e6f5f743 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:34.721366 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-00b3d24d-a23b-48c0-ac41-0732e6f5f743 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:34.928402 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-00b3d24d-a23b-48c0-ac41-0732e6f5f743 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:34.936265 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-00b3d24d-a23b-48c0-ac41-0732e6f5f743 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1516 microversion: 2.1 time: 0.229514 Jun 23 13:44:34.936934 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 343/675] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:34 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1516 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:35.908193 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-09c00797-34f8-4a25-a18f-609671d1c945 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64937d25-0160-49b8-8ea4-869f25f59e22"}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:44:35.909275 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-09c00797-34f8-4a25-a18f-609671d1c945 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:35.916323 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-09c00797-34f8-4a25-a18f-609671d1c945 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:35.916763 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-09c00797-34f8-4a25-a18f-609671d1c945 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:35.917508 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-09c00797-34f8-4a25-a18f-609671d1c945 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:35.917956 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-09c00797-34f8-4a25-a18f-609671d1c945 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:35.955728 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-1ff7635b-85ad-433e-86b5-f2297b8e9bcf tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:35.958913 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-1ff7635b-85ad-433e-86b5-f2297b8e9bcf tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:35.965788 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1ff7635b-85ad-433e-86b5-f2297b8e9bcf tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:35.966322 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1ff7635b-85ad-433e-86b5-f2297b8e9bcf tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:35.967384 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1ff7635b-85ad-433e-86b5-f2297b8e9bcf tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:35.967851 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1ff7635b-85ad-433e-86b5-f2297b8e9bcf tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:36.109656 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-1ff7635b-85ad-433e-86b5-f2297b8e9bcf tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:36.119448 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-1ff7635b-85ad-433e-86b5-f2297b8e9bcf tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1518 microversion: 2.1 time: 0.169260 Jun 23 13:44:36.120273 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 344/676] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:35 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:36.194682 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-09c00797-34f8-4a25-a18f-609671d1c945 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "POST /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290885 Jun 23 13:44:36.199824 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 333/677] 10.222.0.26 () {60 vars in 1322 bytes} [Thu Jun 23 13:44:35 2022] POST /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:44:36.847126 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-80423504-350f-4797-af66-2ef832ce9a20 req-42166512-c3a8-4ede-8349-5e4b669c219a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a0e254-8280-4e56-80e6-525cca5dcac3", "name": "network-vif-unplugged", "status": "completed", "tag": "c680d421-4232-46b9-bea8-b492d2e2f651"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:44:36.858392 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-80423504-350f-4797-af66-2ef832ce9a20 req-42166512-c3a8-4ede-8349-5e4b669c219a service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:36.858918 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-80423504-350f-4797-af66-2ef832ce9a20 req-42166512-c3a8-4ede-8349-5e4b669c219a service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:36.871638 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-80423504-350f-4797-af66-2ef832ce9a20 req-42166512-c3a8-4ede-8349-5e4b669c219a service nova] Creating event network-vif-unplugged:c680d421-4232-46b9-bea8-b492d2e2f651 for instance 89a0e254-8280-4e56-80e6-525cca5dcac3 on hv-cinder-81558 Jun 23 13:44:36.877607 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-80423504-350f-4797-af66-2ef832ce9a20 req-42166512-c3a8-4ede-8349-5e4b669c219a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034845 Jun 23 13:44:36.878869 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 345/678] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:44:37.137930 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-2ffc0bf1-cc9e-4c12-b80e-ee512cbe2187 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:37.138635 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-2ffc0bf1-cc9e-4c12-b80e-ee512cbe2187 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:37.145489 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2ffc0bf1-cc9e-4c12-b80e-ee512cbe2187 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:37.145915 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2ffc0bf1-cc9e-4c12-b80e-ee512cbe2187 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:37.146742 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2ffc0bf1-cc9e-4c12-b80e-ee512cbe2187 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:37.147210 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2ffc0bf1-cc9e-4c12-b80e-ee512cbe2187 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:37.285054 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-2ffc0bf1-cc9e-4c12-b80e-ee512cbe2187 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:37.293431 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-2ffc0bf1-cc9e-4c12-b80e-ee512cbe2187 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1574 microversion: 2.1 time: 0.160350 Jun 23 13:44:37.294094 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 334/679] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:37 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:38.312373 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-6078a984-9e5b-4993-b795-44c5b423ae86 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:38.313146 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-6078a984-9e5b-4993-b795-44c5b423ae86 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:38.315161 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_api:SELECT=62 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:44:38.321320 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6078a984-9e5b-4993-b795-44c5b423ae86 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:38.321770 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6078a984-9e5b-4993-b795-44c5b423ae86 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:38.322592 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6078a984-9e5b-4993-b795-44c5b423ae86 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:38.323025 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6078a984-9e5b-4993-b795-44c5b423ae86 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:38.455934 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-6078a984-9e5b-4993-b795-44c5b423ae86 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:38.466709 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-6078a984-9e5b-4993-b795-44c5b423ae86 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1574 microversion: 2.1 time: 0.159337 Jun 23 13:44:38.467462 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 346/680] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:38 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:39.492868 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-aec0a265-f028-47f4-81d5-1d004a4b3fed tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:39.493866 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-aec0a265-f028-47f4-81d5-1d004a4b3fed tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:39.503146 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-aec0a265-f028-47f4-81d5-1d004a4b3fed tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:39.503630 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-aec0a265-f028-47f4-81d5-1d004a4b3fed tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:39.504389 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-aec0a265-f028-47f4-81d5-1d004a4b3fed tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:39.504826 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-aec0a265-f028-47f4-81d5-1d004a4b3fed tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:39.652389 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-aec0a265-f028-47f4-81d5-1d004a4b3fed tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:39.660157 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-aec0a265-f028-47f4-81d5-1d004a4b3fed tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1574 microversion: 2.1 time: 0.173711 Jun 23 13:44:39.660720 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 335/681] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:39 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1574 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:40.685642 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-0e62ffd4-6936-4336-8d59-1b4cdb9a8177 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:40.686687 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-0e62ffd4-6936-4336-8d59-1b4cdb9a8177 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:40.697732 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0e62ffd4-6936-4336-8d59-1b4cdb9a8177 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:40.698384 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0e62ffd4-6936-4336-8d59-1b4cdb9a8177 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:40.699731 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0e62ffd4-6936-4336-8d59-1b4cdb9a8177 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:40.700471 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0e62ffd4-6936-4336-8d59-1b4cdb9a8177 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:40.844383 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-0e62ffd4-6936-4336-8d59-1b4cdb9a8177 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:40.852169 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-0e62ffd4-6936-4336-8d59-1b4cdb9a8177 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1574 microversion: 2.1 time: 0.173027 Jun 23 13:44:40.852742 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 347/682] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:40 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:41.871804 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-9abb0e29-f012-4567-a761-c9f49056d1d1 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:41.872337 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-9abb0e29-f012-4567-a761-c9f49056d1d1 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:41.879653 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9abb0e29-f012-4567-a761-c9f49056d1d1 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:41.880102 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9abb0e29-f012-4567-a761-c9f49056d1d1 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:41.880857 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9abb0e29-f012-4567-a761-c9f49056d1d1 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:41.881292 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9abb0e29-f012-4567-a761-c9f49056d1d1 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:42.020948 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-9abb0e29-f012-4567-a761-c9f49056d1d1 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:42.032504 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-9abb0e29-f012-4567-a761-c9f49056d1d1 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1574 microversion: 2.1 time: 0.164945 Jun 23 13:44:42.033262 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 336/683] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:41 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:43.051775 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-0eacefba-a49a-4993-aa93-050bc09b3baf tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:43.052840 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-0eacefba-a49a-4993-aa93-050bc09b3baf tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:43.062448 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0eacefba-a49a-4993-aa93-050bc09b3baf tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:43.063114 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0eacefba-a49a-4993-aa93-050bc09b3baf tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:43.064267 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0eacefba-a49a-4993-aa93-050bc09b3baf tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:43.064848 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0eacefba-a49a-4993-aa93-050bc09b3baf tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:43.206636 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-0eacefba-a49a-4993-aa93-050bc09b3baf tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:43.219017 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-0eacefba-a49a-4993-aa93-050bc09b3baf tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1574 microversion: 2.1 time: 0.172378 Jun 23 13:44:43.219606 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 348/684] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:43 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:44.236805 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-b3b724dd-b042-4766-ada1-26a63a912d89 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:44.237516 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-b3b724dd-b042-4766-ada1-26a63a912d89 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:44.244163 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b3b724dd-b042-4766-ada1-26a63a912d89 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:44.244688 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b3b724dd-b042-4766-ada1-26a63a912d89 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:44.245450 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b3b724dd-b042-4766-ada1-26a63a912d89 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:44.245911 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b3b724dd-b042-4766-ada1-26a63a912d89 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:44.250029 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:44:44.336325 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-12aac149-6407-45e4-b76c-02a2376b84fb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:44.336827 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-12aac149-6407-45e4-b76c-02a2376b84fb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:44.343146 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-12aac149-6407-45e4-b76c-02a2376b84fb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:44.343668 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-12aac149-6407-45e4-b76c-02a2376b84fb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:44.344421 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-12aac149-6407-45e4-b76c-02a2376b84fb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:44.344855 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-12aac149-6407-45e4-b76c-02a2376b84fb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:44.377705 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-b3b724dd-b042-4766-ada1-26a63a912d89 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:44.385502 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-b3b724dd-b042-4766-ada1-26a63a912d89 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1574 microversion: 2.1 time: 0.153059 Jun 23 13:44:44.386073 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 337/685] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:44 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:44.423970 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.objects.instance [None req-12aac149-6407-45e4-b76c-02a2376b84fb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lazy-loading 'services' on Instance uuid d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb {{(pid=134667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:44:44.499133 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-12aac149-6407-45e4-b76c-02a2376b84fb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb/os-volume_attachments/e72ae7a9-bc98-4260-9abb-fd01871f19dc" status: 202 len: 0 microversion: 2.1 time: 0.166826 Jun 23 13:44:44.499770 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 349/686] 10.222.0.26 () {58 vars in 1415 bytes} [Thu Jun 23 13:44:44 2022] DELETE /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb/os-volume_attachments/e72ae7a9-bc98-4260-9abb-fd01871f19dc => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 13:44:44.508430 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-535c48a5-9e6e-4e19-bdc9-466729bed335 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:44.509420 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-535c48a5-9e6e-4e19-bdc9-466729bed335 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:44.511280 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_api:SELECT=56 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:44:44.516854 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-535c48a5-9e6e-4e19-bdc9-466729bed335 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:44.517385 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-535c48a5-9e6e-4e19-bdc9-466729bed335 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:44.518204 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-535c48a5-9e6e-4e19-bdc9-466729bed335 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:44.518662 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-535c48a5-9e6e-4e19-bdc9-466729bed335 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:44.549195 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-535c48a5-9e6e-4e19-bdc9-466729bed335 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044947 Jun 23 13:44:44.549776 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 338/687] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Jun 23 13:44:44 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:44:44.827496 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-650b3f44-31c9-47ab-ac93-226fbb2dca4a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64937d25-0160-49b8-8ea4-869f25f59e22"}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:44:44.829403 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-650b3f44-31c9-47ab-ac93-226fbb2dca4a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:44.836197 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-650b3f44-31c9-47ab-ac93-226fbb2dca4a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:44.836637 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-650b3f44-31c9-47ab-ac93-226fbb2dca4a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:44.837393 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-650b3f44-31c9-47ab-ac93-226fbb2dca4a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:44.837825 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-650b3f44-31c9-47ab-ac93-226fbb2dca4a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:44.917642 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.wsgi [None req-650b3f44-31c9-47ab-ac93-226fbb2dca4a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] HTTP exception thrown: Invalid volume: volume 64937d25-0160-49b8-8ea4-869f25f59e22 is already attached to instances: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528 Jun 23 13:44:44.919537 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-650b3f44-31c9-47ab-ac93-226fbb2dca4a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Request method failure captured: Jun 23 13:44:44.919537 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: POST /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528/os-volume_attachments HTTP/1.1 Jun 23 13:44:44.919537 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:44:44.919537 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:44:44.919537 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:44:44.919537 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 74 Jun 23 13:44:44.919537 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:44:44.919537 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:44:44.919537 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:44:44.919537 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:44:44.919537 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitG0I_HZU131M8J85RvEQOmj8LgA_2WxO2JHaCALyqdLluOOVQseCnN3b49kmuLUwl7kgpYu_nyCOuFs2D4nvXDzPB-BFMJHg1SH6Biig2M0dk2RuXu07iB9rawZfYchoQTmmnBEWqWi0vz9e6Q6R4kGGzJ8cvnvjbn-HCeyXQcr5f7s Jun 23 13:44:44.919537 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:44:44.919537 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:44:44.919537 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:44:44.919537 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:44:44.919537 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:44:44.919537 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:44:44.919537 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: 9298bf4635e84993b086309715cc7cbe Jun 23 13:44:44.919537 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:44:44.919537 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:44:44.919537 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:44:44.921171 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9298bf4635e84993b086309715cc7cbe", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:44:44.921171 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:44:44.921171 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: 9298bf4635e84993b086309715cc7cbe Jun 23 13:44:44.921171 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:44:44.921171 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-AttachVolumeNegativeTest-1741631114-project Jun 23 13:44:44.921171 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:44:44.921171 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:44:44.921171 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: 007ce9b8109343e0914efe94c6aa6a89 Jun 23 13:44:44.921171 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-AttachVolumeNegativeTest-1741631114-project Jun 23 13:44:44.921171 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Jun 23 13:44:44.921171 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {"volumeAttachment": {"volumeId": "64937d25-0160-49b8-8ea4-869f25f59e22"}} Jun 23 13:44:44.921171 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: > Jun 23 13:44:44.922005 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Invalid volume: volume 64937d25-0160-49b8-8ea4-869f25f59e22 is already attached to instances: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528 Jun 23 13:44:44.922005 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'server_id': '2d2cbd7f-a2a8-4a8e-beea-655a691d1528', 'body': {'volumeAttachment': {'volumeId': '64937d25-0160-49b8-8ea4-869f25f59e22'}}} Jun 23 13:44:44.922005 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:44:44.922005 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:44:44.922005 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 13:44:44.922005 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 13:44:44.922005 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 13:44:44.922005 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 13:44:44.922005 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 23 13:44:44.922005 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 23 13:44:44.922005 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 23 13:44:44.922005 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 23 13:44:44.922005 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 23 13:44:44.922005 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 23 13:44:44.922005 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 64937d25-0160-49b8-8ea4-869f25f59e22 is already attached to instances: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528 Jun 23 13:44:44.922005 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:44:44.922005 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:44:44.922005 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:44:44.922005 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:44:44.923176 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:44:44.923176 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:44:44.923176 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:44:44.923176 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:44:44.923176 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:44:44.923176 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:44:44.923176 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 13:44:44.923176 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 13:44:44.923176 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 13:44:44.923176 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 13:44:44.923176 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 13:44:44.923176 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 13:44:44.923176 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 23 13:44:44.923176 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 23 13:44:44.923176 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 64937d25-0160-49b8-8ea4-869f25f59e22 is already attached to instances: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528 Jun 23 13:44:44.923176 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:44:44.923176 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:44:44.923176 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:44:44.923176 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:44:44.923176 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:44:44.924432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:44:44.924432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:44:44.924432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:44:44.924432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 64937d25-0160-49b8-8ea4-869f25f59e22 is already attached to instances: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528 Jun 23 13:44:44.924432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:44:44.924432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-650b3f44-31c9-47ab-ac93-226fbb2dca4a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Returning 400 to user: Invalid volume: volume 64937d25-0160-49b8-8ea4-869f25f59e22 is already attached to instances: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528 {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:44:44.924432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-650b3f44-31c9-47ab-ac93-226fbb2dca4a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "POST /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098245 Jun 23 13:44:44.924432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 350/688] 10.222.0.26 () {60 vars in 1322 bytes} [Thu Jun 23 13:44:44 2022] POST /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 13:44:44.984071 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-f5e3a14a-2e9b-4573-8ff5-0ee37ec33d37 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:44.984655 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-f5e3a14a-2e9b-4573-8ff5-0ee37ec33d37 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:44.990629 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f5e3a14a-2e9b-4573-8ff5-0ee37ec33d37 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:44.991076 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f5e3a14a-2e9b-4573-8ff5-0ee37ec33d37 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:44.991863 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f5e3a14a-2e9b-4573-8ff5-0ee37ec33d37 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:44.992300 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f5e3a14a-2e9b-4573-8ff5-0ee37ec33d37 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:45.070512 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.objects.instance [None req-f5e3a14a-2e9b-4573-8ff5-0ee37ec33d37 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lazy-loading 'services' on Instance uuid 2d2cbd7f-a2a8-4a8e-beea-655a691d1528 {{(pid=134666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:44:45.147614 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-f5e3a14a-2e9b-4573-8ff5-0ee37ec33d37 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528/os-volume_attachments/64937d25-0160-49b8-8ea4-869f25f59e22" status: 202 len: 0 microversion: 2.1 time: 0.167164 Jun 23 13:44:45.148751 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 339/689] 10.222.0.26 () {58 vars in 1415 bytes} [Thu Jun 23 13:44:44 2022] DELETE /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528/os-volume_attachments/64937d25-0160-49b8-8ea4-869f25f59e22 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 13:44:45.156882 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-ef88adc2-9768-4dd1-8cd0-c011e5510688 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:45.157760 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-ef88adc2-9768-4dd1-8cd0-c011e5510688 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:45.163704 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ef88adc2-9768-4dd1-8cd0-c011e5510688 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:45.164147 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ef88adc2-9768-4dd1-8cd0-c011e5510688 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:45.164896 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ef88adc2-9768-4dd1-8cd0-c011e5510688 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:45.165325 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ef88adc2-9768-4dd1-8cd0-c011e5510688 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:45.194667 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-ef88adc2-9768-4dd1-8cd0-c011e5510688 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041810 Jun 23 13:44:45.195193 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 351/690] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Jun 23 13:44:45 2022] GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:44:45.403283 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-54becb59-f031-47f3-939e-336d5ad968bc tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:45.404049 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-54becb59-f031-47f3-939e-336d5ad968bc tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:45.411253 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-54becb59-f031-47f3-939e-336d5ad968bc tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:45.411729 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-54becb59-f031-47f3-939e-336d5ad968bc tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:45.412547 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-54becb59-f031-47f3-939e-336d5ad968bc tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:45.413003 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-54becb59-f031-47f3-939e-336d5ad968bc tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:45.561720 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-29d4ac79-b303-4f8b-8a8f-1fb372fdfaae tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:45.562725 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-29d4ac79-b303-4f8b-8a8f-1fb372fdfaae tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:45.563846 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-54becb59-f031-47f3-939e-336d5ad968bc tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:45.569384 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-29d4ac79-b303-4f8b-8a8f-1fb372fdfaae tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:45.569834 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-29d4ac79-b303-4f8b-8a8f-1fb372fdfaae tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:45.570604 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-29d4ac79-b303-4f8b-8a8f-1fb372fdfaae tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:45.571076 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-29d4ac79-b303-4f8b-8a8f-1fb372fdfaae tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:45.571475 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-54becb59-f031-47f3-939e-336d5ad968bc tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1574 microversion: 2.1 time: 0.172422 Jun 23 13:44:45.572131 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 340/691] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:45 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:45.603032 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-29d4ac79-b303-4f8b-8a8f-1fb372fdfaae tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045728 Jun 23 13:44:45.603662 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 352/692] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Jun 23 13:44:45 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:44:46.210926 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-3694987f-c325-4913-9c8e-95712b3c5f6a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:46.212492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-3694987f-c325-4913-9c8e-95712b3c5f6a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:46.221645 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3694987f-c325-4913-9c8e-95712b3c5f6a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:46.221818 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3694987f-c325-4913-9c8e-95712b3c5f6a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:46.222644 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3694987f-c325-4913-9c8e-95712b3c5f6a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:46.223085 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3694987f-c325-4913-9c8e-95712b3c5f6a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:46.253642 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-3694987f-c325-4913-9c8e-95712b3c5f6a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049959 Jun 23 13:44:46.254210 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 341/693] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Jun 23 13:44:46 2022] GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:44:46.588632 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-a45e7cf5-6bd8-470a-9f3d-7330e156cfcc tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:46.589189 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-a45e7cf5-6bd8-470a-9f3d-7330e156cfcc tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:46.596157 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a45e7cf5-6bd8-470a-9f3d-7330e156cfcc tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:46.596676 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a45e7cf5-6bd8-470a-9f3d-7330e156cfcc tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:46.597507 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a45e7cf5-6bd8-470a-9f3d-7330e156cfcc tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:46.598001 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a45e7cf5-6bd8-470a-9f3d-7330e156cfcc tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:46.614924 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-2e20ec2f-b7cd-4268-9211-3832958a89a4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:46.616602 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-2e20ec2f-b7cd-4268-9211-3832958a89a4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:46.624060 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2e20ec2f-b7cd-4268-9211-3832958a89a4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:46.624830 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2e20ec2f-b7cd-4268-9211-3832958a89a4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:46.625963 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2e20ec2f-b7cd-4268-9211-3832958a89a4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:46.626597 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2e20ec2f-b7cd-4268-9211-3832958a89a4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:46.687255 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-2e20ec2f-b7cd-4268-9211-3832958a89a4 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076825 Jun 23 13:44:46.687897 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 342/694] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Jun 23 13:44:46 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 13:44:46.764237 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-a45e7cf5-6bd8-470a-9f3d-7330e156cfcc tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:46.771906 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-a45e7cf5-6bd8-470a-9f3d-7330e156cfcc tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1561 microversion: 2.1 time: 0.187299 Jun 23 13:44:46.773037 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 353/695] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:46 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1561 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:46.781132 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-697a3677-2a31-468d-a0b6-387b8e428e3e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:46.781654 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-697a3677-2a31-468d-a0b6-387b8e428e3e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:46.788299 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-697a3677-2a31-468d-a0b6-387b8e428e3e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:46.788789 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-697a3677-2a31-468d-a0b6-387b8e428e3e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:46.789580 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-697a3677-2a31-468d-a0b6-387b8e428e3e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:46.790017 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-697a3677-2a31-468d-a0b6-387b8e428e3e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:46.814420 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-697a3677-2a31-468d-a0b6-387b8e428e3e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Going to try to terminate instance {{(pid=134666) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 13:44:46.892925 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-697a3677-2a31-468d-a0b6-387b8e428e3e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 204 len: 0 microversion: 2.1 time: 0.115711 Jun 23 13:44:46.893504 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 343/696] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Jun 23 13:44:46 2022] DELETE /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 13:44:46.903398 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-e7eba300-fa9a-4093-8bf4-8431a08530c1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:46.904497 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-e7eba300-fa9a-4093-8bf4-8431a08530c1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:46.911814 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e7eba300-fa9a-4093-8bf4-8431a08530c1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:46.912260 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e7eba300-fa9a-4093-8bf4-8431a08530c1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:46.913028 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e7eba300-fa9a-4093-8bf4-8431a08530c1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:46.913461 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e7eba300-fa9a-4093-8bf4-8431a08530c1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:46.933409 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:44:47.050864 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-e7eba300-fa9a-4093-8bf4-8431a08530c1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:47.058548 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-e7eba300-fa9a-4093-8bf4-8431a08530c1 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1689 microversion: 2.1 time: 0.159435 Jun 23 13:44:47.068297 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 354/697] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:46 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:47.269362 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-577c3c60-d73d-481c-9312-a96b43b39e6b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:47.270534 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-577c3c60-d73d-481c-9312-a96b43b39e6b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:47.277971 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-577c3c60-d73d-481c-9312-a96b43b39e6b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:47.278492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-577c3c60-d73d-481c-9312-a96b43b39e6b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:47.279393 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-577c3c60-d73d-481c-9312-a96b43b39e6b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:47.279894 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-577c3c60-d73d-481c-9312-a96b43b39e6b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:47.313088 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-577c3c60-d73d-481c-9312-a96b43b39e6b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049845 Jun 23 13:44:47.313626 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 344/698] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Jun 23 13:44:47 2022] GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:44:48.079414 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-22e3fc72-815f-4464-be13-71d649ba2e95 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:48.080095 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-22e3fc72-815f-4464-be13-71d649ba2e95 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:48.088441 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-22e3fc72-815f-4464-be13-71d649ba2e95 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:48.088978 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-22e3fc72-815f-4464-be13-71d649ba2e95 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:48.089882 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-22e3fc72-815f-4464-be13-71d649ba2e95 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:48.090394 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-22e3fc72-815f-4464-be13-71d649ba2e95 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:48.226389 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-22e3fc72-815f-4464-be13-71d649ba2e95 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:48.234244 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-22e3fc72-815f-4464-be13-71d649ba2e95 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1689 microversion: 2.1 time: 0.161132 Jun 23 13:44:48.234824 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 355/699] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:48 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:48.328136 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-081dbfc7-d962-4a53-96c0-3e5b337314b2 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:48.329047 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-081dbfc7-d962-4a53-96c0-3e5b337314b2 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:48.336164 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-081dbfc7-d962-4a53-96c0-3e5b337314b2 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:48.336542 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-081dbfc7-d962-4a53-96c0-3e5b337314b2 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:48.337293 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-081dbfc7-d962-4a53-96c0-3e5b337314b2 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:48.337718 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-081dbfc7-d962-4a53-96c0-3e5b337314b2 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:48.366411 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-081dbfc7-d962-4a53-96c0-3e5b337314b2 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045107 Jun 23 13:44:48.366972 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 345/700] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Jun 23 13:44:48 2022] GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:44:48.930787 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-5c7be384-e0ec-44ec-9a4c-d57d94855c2d req-cbf4d6ea-3e12-414b-b9ad-8a483150cd52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a0e254-8280-4e56-80e6-525cca5dcac3", "name": "network-vif-plugged", "status": "completed", "tag": "c680d421-4232-46b9-bea8-b492d2e2f651"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:44:48.939606 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-5c7be384-e0ec-44ec-9a4c-d57d94855c2d req-cbf4d6ea-3e12-414b-b9ad-8a483150cd52 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:48.940052 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-5c7be384-e0ec-44ec-9a4c-d57d94855c2d req-cbf4d6ea-3e12-414b-b9ad-8a483150cd52 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:48.951357 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-5c7be384-e0ec-44ec-9a4c-d57d94855c2d req-cbf4d6ea-3e12-414b-b9ad-8a483150cd52 service nova] Creating event network-vif-plugged:c680d421-4232-46b9-bea8-b492d2e2f651 for instance 89a0e254-8280-4e56-80e6-525cca5dcac3 on hv-cinder-81558 Jun 23 13:44:48.956691 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-5c7be384-e0ec-44ec-9a4c-d57d94855c2d req-cbf4d6ea-3e12-414b-b9ad-8a483150cd52 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029593 Jun 23 13:44:48.957654 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 356/701] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:44:49.253119 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c10edb43-5284-43b2-a9f7-925b1137db92 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:49.253722 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-c10edb43-5284-43b2-a9f7-925b1137db92 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:49.260137 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c10edb43-5284-43b2-a9f7-925b1137db92 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:49.260583 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c10edb43-5284-43b2-a9f7-925b1137db92 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:49.261330 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c10edb43-5284-43b2-a9f7-925b1137db92 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:49.261766 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c10edb43-5284-43b2-a9f7-925b1137db92 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:49.379225 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-e1d9f9f2-086e-473f-b067-2af163152b99 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:49.380224 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-e1d9f9f2-086e-473f-b067-2af163152b99 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:49.386701 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e1d9f9f2-086e-473f-b067-2af163152b99 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:49.387152 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e1d9f9f2-086e-473f-b067-2af163152b99 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:49.387942 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e1d9f9f2-086e-473f-b067-2af163152b99 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:49.388378 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e1d9f9f2-086e-473f-b067-2af163152b99 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:49.395530 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-c10edb43-5284-43b2-a9f7-925b1137db92 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:49.403066 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-c10edb43-5284-43b2-a9f7-925b1137db92 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1689 microversion: 2.1 time: 0.154650 Jun 23 13:44:49.403685 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 346/702] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:49 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:49.418500 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-e1d9f9f2-086e-473f-b067-2af163152b99 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044193 Jun 23 13:44:49.419023 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 357/703] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Jun 23 13:44:49 2022] GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:44:50.420378 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-a6a2817a-725f-4c54-98ee-6c14567ade61 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:50.420964 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-a6a2817a-725f-4c54-98ee-6c14567ade61 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:50.427767 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a6a2817a-725f-4c54-98ee-6c14567ade61 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:50.428212 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a6a2817a-725f-4c54-98ee-6c14567ade61 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:50.428967 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a6a2817a-725f-4c54-98ee-6c14567ade61 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:50.429394 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a6a2817a-725f-4c54-98ee-6c14567ade61 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:50.430160 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-1c5c7733-e400-45f6-8a47-3e10f84ed0f0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:50.431147 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-1c5c7733-e400-45f6-8a47-3e10f84ed0f0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:50.437766 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1c5c7733-e400-45f6-8a47-3e10f84ed0f0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:50.438196 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1c5c7733-e400-45f6-8a47-3e10f84ed0f0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:50.438963 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1c5c7733-e400-45f6-8a47-3e10f84ed0f0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:50.439419 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1c5c7733-e400-45f6-8a47-3e10f84ed0f0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:50.469153 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-1c5c7733-e400-45f6-8a47-3e10f84ed0f0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042853 Jun 23 13:44:50.469729 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 358/704] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Jun 23 13:44:50 2022] GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 13:44:50.534085 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-3ebe55e9-baf6-4613-81c0-aa506c5d58e4 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:50.534583 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-3ebe55e9-baf6-4613-81c0-aa506c5d58e4 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:50.541051 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3ebe55e9-baf6-4613-81c0-aa506c5d58e4 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:50.541496 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3ebe55e9-baf6-4613-81c0-aa506c5d58e4 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:50.542258 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3ebe55e9-baf6-4613-81c0-aa506c5d58e4 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:50.542689 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3ebe55e9-baf6-4613-81c0-aa506c5d58e4 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:50.567951 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-a6a2817a-725f-4c54-98ee-6c14567ade61 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:50.569533 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-3ebe55e9-baf6-4613-81c0-aa506c5d58e4 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Going to try to terminate instance {{(pid=134667) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 13:44:50.576477 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-a6a2817a-725f-4c54-98ee-6c14567ade61 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1689 microversion: 2.1 time: 0.160015 Jun 23 13:44:50.577051 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 347/705] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:50 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:50.648090 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-3ebe55e9-baf6-4613-81c0-aa506c5d58e4 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528" status: 204 len: 0 microversion: 2.1 time: 0.117424 Jun 23 13:44:50.648683 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 359/706] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Jun 23 13:44:50 2022] DELETE /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 13:44:50.657562 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-e41de1d3-c7f9-4c8c-9ccc-d9c01979cb28 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:50.658164 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-e41de1d3-c7f9-4c8c-9ccc-d9c01979cb28 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:50.664349 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e41de1d3-c7f9-4c8c-9ccc-d9c01979cb28 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:50.664805 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e41de1d3-c7f9-4c8c-9ccc-d9c01979cb28 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:50.665575 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e41de1d3-c7f9-4c8c-9ccc-d9c01979cb28 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:50.666080 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e41de1d3-c7f9-4c8c-9ccc-d9c01979cb28 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:50.803620 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-e41de1d3-c7f9-4c8c-9ccc-d9c01979cb28 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:50.810575 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-e41de1d3-c7f9-4c8c-9ccc-d9c01979cb28 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528" status: 200 len: 1682 microversion: 2.1 time: 0.157296 Jun 23 13:44:50.811151 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 348/707] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:50 2022] GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:51.599261 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-8a47b5ee-d126-4fe0-bd75-ed2541701617 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:51.600441 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-8a47b5ee-d126-4fe0-bd75-ed2541701617 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:51.611503 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8a47b5ee-d126-4fe0-bd75-ed2541701617 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:51.612254 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8a47b5ee-d126-4fe0-bd75-ed2541701617 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:51.613512 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8a47b5ee-d126-4fe0-bd75-ed2541701617 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:51.614280 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8a47b5ee-d126-4fe0-bd75-ed2541701617 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:51.757283 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-8a47b5ee-d126-4fe0-bd75-ed2541701617 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:51.765382 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-8a47b5ee-d126-4fe0-bd75-ed2541701617 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1689 microversion: 2.1 time: 0.173337 Jun 23 13:44:51.765984 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 360/708] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:51 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1689 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:51.828328 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-55eb3ea3-4062-4c09-a232-4dba6f3a97ae tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:51.828929 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-55eb3ea3-4062-4c09-a232-4dba6f3a97ae tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:51.836215 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-55eb3ea3-4062-4c09-a232-4dba6f3a97ae tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:51.836658 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-55eb3ea3-4062-4c09-a232-4dba6f3a97ae tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:51.837419 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-55eb3ea3-4062-4c09-a232-4dba6f3a97ae tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:51.837848 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-55eb3ea3-4062-4c09-a232-4dba6f3a97ae tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:51.966875 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-55eb3ea3-4062-4c09-a232-4dba6f3a97ae tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:51.974793 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-55eb3ea3-4062-4c09-a232-4dba6f3a97ae tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528" status: 200 len: 1682 microversion: 2.1 time: 0.150378 Jun 23 13:44:51.975394 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 349/709] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:51 2022] GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:52.782734 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-4e129931-ea92-477f-a262-3c273901df3d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:52.783369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-4e129931-ea92-477f-a262-3c273901df3d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:52.794136 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4e129931-ea92-477f-a262-3c273901df3d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:52.794705 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4e129931-ea92-477f-a262-3c273901df3d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:52.795609 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4e129931-ea92-477f-a262-3c273901df3d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:52.796285 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4e129931-ea92-477f-a262-3c273901df3d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:52.862091 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-4e129931-ea92-477f-a262-3c273901df3d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:52.869906 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-4e129931-ea92-477f-a262-3c273901df3d tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 200 len: 1622 microversion: 2.1 time: 0.091162 Jun 23 13:44:52.870538 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 361/710] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:52 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 1622 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:44:52.992461 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-07c7308f-08c4-469c-860f-90e97f44200a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:52.993032 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-07c7308f-08c4-469c-860f-90e97f44200a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:53.000106 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-07c7308f-08c4-469c-860f-90e97f44200a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:53.000556 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-07c7308f-08c4-469c-860f-90e97f44200a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:53.001323 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-07c7308f-08c4-469c-860f-90e97f44200a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:53.001757 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-07c7308f-08c4-469c-860f-90e97f44200a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:53.143702 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-07c7308f-08c4-469c-860f-90e97f44200a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:53.151643 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-07c7308f-08c4-469c-860f-90e97f44200a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528" status: 200 len: 1682 microversion: 2.1 time: 0.163004 Jun 23 13:44:53.153019 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 350/711] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:52 2022] GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:53.356457 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-84f19748-a8dc-43aa-a161-cc24b89b6cbb req-82cd7d65-ba08-462f-be47-bb55ed12a7c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb", "name": "network-vif-deleted", "tag": "60ed90f0-c222-4a32-aa94-aa23838b7b54"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:44:53.366650 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-84f19748-a8dc-43aa-a161-cc24b89b6cbb req-82cd7d65-ba08-462f-be47-bb55ed12a7c6 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:53.367008 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-84f19748-a8dc-43aa-a161-cc24b89b6cbb req-82cd7d65-ba08-462f-be47-bb55ed12a7c6 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:53.389977 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-84f19748-a8dc-43aa-a161-cc24b89b6cbb req-82cd7d65-ba08-462f-be47-bb55ed12a7c6 service nova] Creating event network-vif-deleted:60ed90f0-c222-4a32-aa94-aa23838b7b54 for instance d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb on hv-cinder-81558 Jun 23 13:44:53.396467 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-84f19748-a8dc-43aa-a161-cc24b89b6cbb req-82cd7d65-ba08-462f-be47-bb55ed12a7c6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150167 Jun 23 13:44:53.397105 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 362/712] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:44:53.886999 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-2980c7e6-7db9-4799-a165-e66c20b896b0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:53.887652 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-2980c7e6-7db9-4799-a165-e66c20b896b0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:53.895529 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2980c7e6-7db9-4799-a165-e66c20b896b0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:53.896142 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2980c7e6-7db9-4799-a165-e66c20b896b0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:53.902549 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2980c7e6-7db9-4799-a165-e66c20b896b0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:53.903237 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2980c7e6-7db9-4799-a165-e66c20b896b0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:53.921700 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.wsgi [None req-2980c7e6-7db9-4799-a165-e66c20b896b0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] HTTP exception thrown: Instance d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb could not be found. Jun 23 13:44:53.931404 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-2980c7e6-7db9-4799-a165-e66c20b896b0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Request method failure captured: Jun 23 13:44:53.931404 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: request: GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb HTTP/1.1 Jun 23 13:44:53.931404 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept: application/json Jun 23 13:44:53.931404 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept-Encoding: identity Jun 23 13:44:53.931404 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Connection: close Jun 23 13:44:53.931404 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Length: 0 Jun 23 13:44:53.931404 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Type: application/json Jun 23 13:44:53.931404 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Host: 10.222.0.26 Jun 23 13:44:53.931404 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Openstack-System-Scope: None Jun 23 13:44:53.931404 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: User-Agent: python-urllib3/1.26.9 Jun 23 13:44:53.931404 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Auth-Token: gAAAAABitG0Sk3ITYqPOix6d-yn0tfx-OSIDvIuV7UJjc74SbWZgVnKUDm8nfkPPw_HDdmKI8sNR-ZRrPiM2VFS2aGUijneFicZmaRheJVdwbvopsixSQO0yPOZxFVs3fvoZ2ibh1WvoqBrlfRHbN7g-Iz0o0UFhet-npHvAovII03AWNWb9zgg Jun 23 13:44:53.931404 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Id: None Jun 23 13:44:53.931404 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Name: None Jun 23 13:44:53.931404 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Identity-Status: Confirmed Jun 23 13:44:53.931404 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Is-Admin-Project: True Jun 23 13:44:53.931404 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Id: default Jun 23 13:44:53.931404 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Name: Default Jun 23 13:44:53.931404 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Id: 855cb6e79485414ab0f2a40162231d72 Jun 23 13:44:53.931404 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-140294951 Jun 23 13:44:53.931404 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Role: member,reader Jun 23 13:44:53.931404 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Roles: member,reader Jun 23 13:44:53.932907 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/855cb6e79485414ab0f2a40162231d72"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/855cb6e79485414ab0f2a40162231d72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/855cb6e79485414ab0f2a40162231d72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_855cb6e79485414ab0f2a40162231d72", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:44:53.932907 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant: tempest-ServerRescueNegativeTestJSON-140294951 Jun 23 13:44:53.932907 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Id: 855cb6e79485414ab0f2a40162231d72 Jun 23 13:44:53.932907 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-140294951 Jun 23 13:44:53.932907 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User: tempest-ServerRescueNegativeTestJSON-140294951-project Jun 23 13:44:53.932907 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Id: default Jun 23 13:44:53.932907 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Name: Default Jun 23 13:44:53.932907 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Id: ae510389cfc04a0cb4e6991df2a93a00 Jun 23 13:44:53.932907 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Name: tempest-ServerRescueNegativeTestJSON-140294951-project Jun 23 13:44:53.932907 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: method: > Jun 23 13:44:53.932907 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: exception: Instance d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb could not be found. Jun 23 13:44:53.932907 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: action_args: {'id': 'd93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb'} Jun 23 13:44:53.933697 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:44:53.933697 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:44:53.933697 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:44:53.933697 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:44:53.933697 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:44:53.933697 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:44:53.933697 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:44:53.933697 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:44:53.933697 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:44:53.933697 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:44:53.933697 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb could not be found. Jun 23 13:44:53.933697 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:44:53.933697 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:44:53.933697 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:44:53.933697 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:44:53.933697 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:44:53.933697 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:44:53.933697 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:44:53.933697 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:44:53.933697 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:44:53.938520 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:44:53.938520 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:44:53.938520 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:44:53.938520 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:44:53.938520 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:44:53.938520 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:44:53.938520 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:44:53.938520 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb could not be found. Jun 23 13:44:53.938520 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:44:53.938520 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:44:53.938520 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:44:53.938520 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:44:53.938520 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:44:53.938520 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:44:53.938520 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:44:53.938520 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:44:53.938520 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb could not be found. Jun 23 13:44:53.938520 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:44:53.939692 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-2980c7e6-7db9-4799-a165-e66c20b896b0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Returning 404 to user: Instance d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb could not be found. {{(pid=134666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:44:53.939692 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-2980c7e6-7db9-4799-a165-e66c20b896b0 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb" status: 404 len: 111 microversion: 2.1 time: 0.051213 Jun 23 13:44:53.939692 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 351/713] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:53 2022] GET /compute/v2.1/servers/d93d96e2-43e5-4b57-bcb4-ca8e2f4d5dcb => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:44:53.942809 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-6e9bac85-5171-485e-b7ed-82d4aff87868 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '.version_select at 0x7fd772207820>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:53.966792 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-6e9bac85-5171-485e-b7ed-82d4aff87868 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1031938696" status: 202 len: 0 microversion: 2.1 time: 0.027907 Jun 23 13:44:53.968056 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 363/714] 10.222.0.26 () {58 vars in 1220 bytes} [Thu Jun 23 13:44:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1031938696 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 13:44:54.169228 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-4bf0f4f5-65c0-4b1b-a57e-05b97a3fc839 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:54.169976 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-4bf0f4f5-65c0-4b1b-a57e-05b97a3fc839 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:54.181439 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4bf0f4f5-65c0-4b1b-a57e-05b97a3fc839 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:54.182248 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4bf0f4f5-65c0-4b1b-a57e-05b97a3fc839 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:54.182857 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4bf0f4f5-65c0-4b1b-a57e-05b97a3fc839 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:54.185495 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4bf0f4f5-65c0-4b1b-a57e-05b97a3fc839 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:54.215452 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:44:54.239630 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4bf0f4f5-65c0-4b1b-a57e-05b97a3fc839 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:54.240825 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4bf0f4f5-65c0-4b1b-a57e-05b97a3fc839 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:54.241370 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.objects.instance [None req-4bf0f4f5-65c0-4b1b-a57e-05b97a3fc839 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lazy-loading 'fault' on Instance uuid 2d2cbd7f-a2a8-4a8e-beea-655a691d1528 {{(pid=134666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:44:54.284119 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-4bf0f4f5-65c0-4b1b-a57e-05b97a3fc839 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:54.292446 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-4bf0f4f5-65c0-4b1b-a57e-05b97a3fc839 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528" status: 200 len: 1332 microversion: 2.1 time: 0.127304 Jun 23 13:44:54.293360 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 352/715] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:54 2022] GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528 => generated 1332 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:55.312486 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-b71670d1-862b-40e8-8a63-10e261bd74cf tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:55.313229 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-b71670d1-862b-40e8-8a63-10e261bd74cf tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:55.320420 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b71670d1-862b-40e8-8a63-10e261bd74cf tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:55.320861 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b71670d1-862b-40e8-8a63-10e261bd74cf tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:55.321702 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b71670d1-862b-40e8-8a63-10e261bd74cf tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:55.322139 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b71670d1-862b-40e8-8a63-10e261bd74cf tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:55.336002 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.wsgi [None req-b71670d1-862b-40e8-8a63-10e261bd74cf tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] HTTP exception thrown: Instance 2d2cbd7f-a2a8-4a8e-beea-655a691d1528 could not be found. Jun 23 13:44:55.337658 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-b71670d1-862b-40e8-8a63-10e261bd74cf tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Request method failure captured: Jun 23 13:44:55.337658 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528 HTTP/1.1 Jun 23 13:44:55.337658 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:44:55.337658 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:44:55.337658 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:44:55.337658 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 0 Jun 23 13:44:55.337658 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:44:55.337658 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:44:55.337658 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:44:55.337658 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:44:55.337658 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitG0I_HZU131M8J85RvEQOmj8LgA_2WxO2JHaCALyqdLluOOVQseCnN3b49kmuLUwl7kgpYu_nyCOuFs2D4nvXDzPB-BFMJHg1SH6Biig2M0dk2RuXu07iB9rawZfYchoQTmmnBEWqWi0vz9e6Q6R4kGGzJ8cvnvjbn-HCeyXQcr5f7s Jun 23 13:44:55.337658 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:44:55.337658 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:44:55.337658 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:44:55.337658 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:44:55.337658 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:44:55.337658 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:44:55.337658 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: 9298bf4635e84993b086309715cc7cbe Jun 23 13:44:55.337658 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:44:55.337658 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:44:55.337658 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:44:55.339298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9298bf4635e84993b086309715cc7cbe", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:44:55.339298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:44:55.339298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: 9298bf4635e84993b086309715cc7cbe Jun 23 13:44:55.339298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:44:55.339298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-AttachVolumeNegativeTest-1741631114-project Jun 23 13:44:55.339298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:44:55.339298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:44:55.339298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: 007ce9b8109343e0914efe94c6aa6a89 Jun 23 13:44:55.339298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-AttachVolumeNegativeTest-1741631114-project Jun 23 13:44:55.339298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: > Jun 23 13:44:55.339298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Instance 2d2cbd7f-a2a8-4a8e-beea-655a691d1528 could not be found. Jun 23 13:44:55.339298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'id': '2d2cbd7f-a2a8-4a8e-beea-655a691d1528'} Jun 23 13:44:55.340589 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:44:55.340589 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:44:55.340589 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:44:55.340589 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:44:55.340589 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:44:55.340589 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:44:55.340589 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:44:55.340589 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:44:55.340589 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:44:55.340589 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:44:55.340589 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d2cbd7f-a2a8-4a8e-beea-655a691d1528 could not be found. Jun 23 13:44:55.340589 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:44:55.340589 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:44:55.340589 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:44:55.340589 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:44:55.340589 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:44:55.340589 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:44:55.340589 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:44:55.340589 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:44:55.340589 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:44:55.341954 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:44:55.341954 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:44:55.341954 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:44:55.341954 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:44:55.341954 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:44:55.341954 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:44:55.341954 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:44:55.341954 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d2cbd7f-a2a8-4a8e-beea-655a691d1528 could not be found. Jun 23 13:44:55.341954 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:44:55.341954 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:44:55.341954 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:44:55.341954 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:44:55.341954 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:44:55.341954 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:44:55.341954 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:44:55.341954 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:44:55.341954 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d2cbd7f-a2a8-4a8e-beea-655a691d1528 could not be found. Jun 23 13:44:55.341954 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:44:55.343195 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-b71670d1-862b-40e8-8a63-10e261bd74cf tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Returning 404 to user: Instance 2d2cbd7f-a2a8-4a8e-beea-655a691d1528 could not be found. {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:44:55.343195 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-b71670d1-862b-40e8-8a63-10e261bd74cf tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528" status: 404 len: 111 microversion: 2.1 time: 0.032809 Jun 23 13:44:55.343195 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 364/716] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:55 2022] GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:44:55.349902 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-169977a3-040f-4fba-9b11-ef56f799e041 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '.version_select at 0x7fd772378280>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:55.372551 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-169977a3-040f-4fba-9b11-ef56f799e041 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1907845218" status: 202 len: 0 microversion: 2.1 time: 0.027098 Jun 23 13:44:55.373672 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 353/717] 10.222.0.26 () {58 vars in 1220 bytes} [Thu Jun 23 13:44:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1907845218 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 13:44:55.425698 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-5c5da1ab-1fc3-4fb5-b6ad-2fac978be81b req-b8240c24-32db-4ae8-a257-30de530be094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d2cbd7f-a2a8-4a8e-beea-655a691d1528", "name": "network-vif-deleted", "tag": "11905686-c708-4716-8310-c8bbd7705aa0"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:44:55.434199 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-5c5da1ab-1fc3-4fb5-b6ad-2fac978be81b req-b8240c24-32db-4ae8-a257-30de530be094 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:55.434651 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-5c5da1ab-1fc3-4fb5-b6ad-2fac978be81b req-b8240c24-32db-4ae8-a257-30de530be094 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:55.445945 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-5c5da1ab-1fc3-4fb5-b6ad-2fac978be81b req-b8240c24-32db-4ae8-a257-30de530be094 service nova] Creating event network-vif-deleted:11905686-c708-4716-8310-c8bbd7705aa0 for instance 2d2cbd7f-a2a8-4a8e-beea-655a691d1528 on hv-cinder-81558 Jun 23 13:44:55.450942 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-5c5da1ab-1fc3-4fb5-b6ad-2fac978be81b req-b8240c24-32db-4ae8-a257-30de530be094 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029012 Jun 23 13:44:55.451551 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 365/718] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:44:56.026482 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-f540330e-b652-448f-a4e5-7272d302a246 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Action: 'create', calling method: .version_select at 0x7fd77233fd30>, body: {"keypair": {"name": "tempest-keypair-240769615", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjfe46vNrydlr6PpvyPAx/FVdvqKIBftrsYxFSG/UiwZrdV6t0VcKX3sLhaXgNQE/3UYzs4YE4REqjV/Okm8OfyIoY2pmQDgdbiKUTDuxxlxj7yKJpxOFF/L8IPepyD6w=="}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:44:56.040883 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-f540330e-b652-448f-a4e5-7272d302a246 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Getting quotas for project 9298bf4635e84993b086309715cc7cbe. Resources: {'key_pairs'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:44:56.044611 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-f540330e-b652-448f-a4e5-7272d302a246 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Getting quotas for user 007ce9b8109343e0914efe94c6aa6a89 and project 9298bf4635e84993b086309715cc7cbe. Resources: {'key_pairs'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:44:56.066738 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-f540330e-b652-448f-a4e5-7272d302a246 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044939 Jun 23 13:44:56.067362 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 354/719] 10.222.0.26 () {60 vars in 1158 bytes} [Thu Jun 23 13:44:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:44:56.917068 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-7a001485-5947-4213-8135-231a15f9dc47 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:56.917638 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-7a001485-5947-4213-8135-231a15f9dc47 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:56.926966 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7a001485-5947-4213-8135-231a15f9dc47 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:56.926966 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7a001485-5947-4213-8135-231a15f9dc47 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:56.926966 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7a001485-5947-4213-8135-231a15f9dc47 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:56.926966 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7a001485-5947-4213-8135-231a15f9dc47 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:56.953571 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-7a001485-5947-4213-8135-231a15f9dc47 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Going to try to terminate instance {{(pid=134667) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 13:44:57.036065 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-7a001485-5947-4213-8135-231a15f9dc47 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 204 len: 0 microversion: 2.1 time: 0.123414 Jun 23 13:44:57.036924 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 366/720] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Jun 23 13:44:56 2022] DELETE /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 13:44:57.047565 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-4e5462e8-d72c-4cd9-aa01-aa4eee9b1512 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:57.048493 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-4e5462e8-d72c-4cd9-aa01-aa4eee9b1512 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:57.056143 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4e5462e8-d72c-4cd9-aa01-aa4eee9b1512 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:57.056593 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4e5462e8-d72c-4cd9-aa01-aa4eee9b1512 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:57.057579 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4e5462e8-d72c-4cd9-aa01-aa4eee9b1512 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:57.058021 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4e5462e8-d72c-4cd9-aa01-aa4eee9b1512 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:57.188176 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-4e5462e8-d72c-4cd9-aa01-aa4eee9b1512 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:57.195791 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-4e5462e8-d72c-4cd9-aa01-aa4eee9b1512 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1506 microversion: 2.1 time: 0.154040 Jun 23 13:44:57.196358 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 355/721] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:57 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:57.569061 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-6788d7c5-9438-4dbc-9315-ecc9f20abc50 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-889487884", "imageRef": "dd7aacbf-3b3e-496e-967e-53d2a1b1f200", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "750f6de3-a7e6-4721-b369-b46085e03f9a"}], "security_groups": [{"name": "tempest-securitygroup--589186209"}], "key_name": "tempest-keypair-240769615", "user_data": "}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:44:57.679260 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.network.neutron [None req-6788d7c5-9438-4dbc-9315-ecc9f20abc50 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] validate_networks() for [('750f6de3-a7e6-4721-b369-b46085e03f9a', None, None, None, None, None)] {{(pid=134667) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 13:44:58.099282 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-6788d7c5-9438-4dbc-9315-ecc9f20abc50 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Flavor limits 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 13:44:58.099881 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-6788d7c5-9438-4dbc-9315-ecc9f20abc50 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Image limits 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 13:44:58.100199 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-6788d7c5-9438-4dbc-9315-ecc9f20abc50 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Flavor pref 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 13:44:58.100609 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-6788d7c5-9438-4dbc-9315-ecc9f20abc50 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Image pref 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 13:44:58.101041 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-6788d7c5-9438-4dbc-9315-ecc9f20abc50 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 13:44:58.110511 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6788d7c5-9438-4dbc-9315-ecc9f20abc50 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:58.110932 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6788d7c5-9438-4dbc-9315-ecc9f20abc50 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:58.111738 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6788d7c5-9438-4dbc-9315-ecc9f20abc50 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:58.112174 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6788d7c5-9438-4dbc-9315-ecc9f20abc50 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:58.128790 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.quota [None req-6788d7c5-9438-4dbc-9315-ecc9f20abc50 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Getting quotas for project 9298bf4635e84993b086309715cc7cbe. Resources: {'ram', 'cores', 'instances'} {{(pid=134667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:44:58.132882 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.quota [None req-6788d7c5-9438-4dbc-9315-ecc9f20abc50 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Getting quotas for user 007ce9b8109343e0914efe94c6aa6a89 and project 9298bf4635e84993b086309715cc7cbe. Resources: {'ram', 'cores', 'instances'} {{(pid=134667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:44:58.144192 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-6788d7c5-9438-4dbc-9315-ecc9f20abc50 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Going to run 1 instances... {{(pid=134667) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 13:44:58.146577 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-6788d7c5-9438-4dbc-9315-ecc9f20abc50 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 7840b5d2-52e9-48db-95ba-af0fb4a5cb52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7aacbf-3b3e-496e-967e-53d2a1b1f200',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134667) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 13:44:58.197713 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-6788d7c5-9438-4dbc-9315-ecc9f20abc50 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.633330 Jun 23 13:44:58.198633 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 367/722] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Jun 23 13:44:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 13:44:58.209267 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-9f3201bc-5c01-4894-9790-0be48cdabd3d tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:58.210468 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-9f3201bc-5c01-4894-9790-0be48cdabd3d tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 7840b5d2-52e9-48db-95ba-af0fb4a5cb52] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:58.228408 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-43883187-d298-40b6-beb5-4a99e7ddc32a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:58.229055 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-43883187-d298-40b6-beb5-4a99e7ddc32a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:58.235885 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-43883187-d298-40b6-beb5-4a99e7ddc32a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:58.236339 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-43883187-d298-40b6-beb5-4a99e7ddc32a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:58.237121 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-43883187-d298-40b6-beb5-4a99e7ddc32a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:58.237560 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-43883187-d298-40b6-beb5-4a99e7ddc32a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:58.270419 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-9f3201bc-5c01-4894-9790-0be48cdabd3d tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:58.278342 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-9f3201bc-5c01-4894-9790-0be48cdabd3d tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52" status: 200 len: 1240 microversion: 2.1 time: 0.073539 Jun 23 13:44:58.278921 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 356/723] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:58 2022] GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52 => generated 1240 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:58.372682 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-43883187-d298-40b6-beb5-4a99e7ddc32a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:58.380433 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-43883187-d298-40b6-beb5-4a99e7ddc32a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1506 microversion: 2.1 time: 0.167526 Jun 23 13:44:58.381092 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 368/724] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:58 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:59.295368 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-ff01e6b7-b3d1-40eb-8490-675f95c4e685 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:59.296860 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-ff01e6b7-b3d1-40eb-8490-675f95c4e685 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 7840b5d2-52e9-48db-95ba-af0fb4a5cb52] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:59.304187 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ff01e6b7-b3d1-40eb-8490-675f95c4e685 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:59.304985 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ff01e6b7-b3d1-40eb-8490-675f95c4e685 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:59.305823 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ff01e6b7-b3d1-40eb-8490-675f95c4e685 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:59.306329 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ff01e6b7-b3d1-40eb-8490-675f95c4e685 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:59.376055 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-ff01e6b7-b3d1-40eb-8490-675f95c4e685 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:59.384061 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-ff01e6b7-b3d1-40eb-8490-675f95c4e685 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52" status: 200 len: 1292 microversion: 2.1 time: 0.092549 Jun 23 13:44:59.395428 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 357/725] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:59 2022] GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52 => generated 1292 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:59.398264 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-b6b58cbf-b5c5-4fd4-822d-f9a5066f5070 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:44:59.398882 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-b6b58cbf-b5c5-4fd4-822d-f9a5066f5070 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:44:59.406598 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b6b58cbf-b5c5-4fd4-822d-f9a5066f5070 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:59.407081 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b6b58cbf-b5c5-4fd4-822d-f9a5066f5070 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:59.407884 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b6b58cbf-b5c5-4fd4-822d-f9a5066f5070 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:59.408496 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b6b58cbf-b5c5-4fd4-822d-f9a5066f5070 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:59.545008 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-b6b58cbf-b5c5-4fd4-822d-f9a5066f5070 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:44:59.555978 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-b6b58cbf-b5c5-4fd4-822d-f9a5066f5070 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 200 len: 1506 microversion: 2.1 time: 0.161949 Jun 23 13:44:59.556570 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 369/726] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:44:59 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:44:59.950009 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-0ef53c1c-94a1-443b-b0a2-cc72ba9c4291 req-ae25d967-a5e4-4d12-8213-0654596c996c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a45e219e-e492-44d7-a962-1a741b0abcaa", "name": "network-vif-deleted", "tag": "a620a38f-71e7-45a8-b6c8-6d3333e3b7a7"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:44:59.960613 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-0ef53c1c-94a1-443b-b0a2-cc72ba9c4291 req-ae25d967-a5e4-4d12-8213-0654596c996c service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:44:59.961435 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-0ef53c1c-94a1-443b-b0a2-cc72ba9c4291 req-ae25d967-a5e4-4d12-8213-0654596c996c service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:44:59.973704 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-0ef53c1c-94a1-443b-b0a2-cc72ba9c4291 req-ae25d967-a5e4-4d12-8213-0654596c996c service nova] Creating event network-vif-deleted:a620a38f-71e7-45a8-b6c8-6d3333e3b7a7 for instance a45e219e-e492-44d7-a962-1a741b0abcaa on hv-cinder-81558 Jun 23 13:44:59.979467 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-0ef53c1c-94a1-443b-b0a2-cc72ba9c4291 req-ae25d967-a5e4-4d12-8213-0654596c996c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035019 Jun 23 13:44:59.979982 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 358/727] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:45:00.404002 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-edc7f7f5-4638-477a-94f5-6d4125bc294e tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:00.404783 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-edc7f7f5-4638-477a-94f5-6d4125bc294e tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 7840b5d2-52e9-48db-95ba-af0fb4a5cb52] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:00.411892 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-edc7f7f5-4638-477a-94f5-6d4125bc294e tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:00.412348 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-edc7f7f5-4638-477a-94f5-6d4125bc294e tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:00.413212 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-edc7f7f5-4638-477a-94f5-6d4125bc294e tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:00.414192 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-edc7f7f5-4638-477a-94f5-6d4125bc294e tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:00.561042 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-edc7f7f5-4638-477a-94f5-6d4125bc294e tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:00.569120 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-edc7f7f5-4638-477a-94f5-6d4125bc294e tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52" status: 200 len: 1365 microversion: 2.1 time: 0.171085 Jun 23 13:45:00.574955 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-5a352db1-15ab-45b9-9d09-d81b01763d0a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:00.576235 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-5a352db1-15ab-45b9-9d09-d81b01763d0a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: a45e219e-e492-44d7-a962-1a741b0abcaa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:00.579751 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 370/728] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:45:00 2022] GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:45:00.583315 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5a352db1-15ab-45b9-9d09-d81b01763d0a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:00.583799 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5a352db1-15ab-45b9-9d09-d81b01763d0a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:00.584566 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5a352db1-15ab-45b9-9d09-d81b01763d0a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:00.585004 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5a352db1-15ab-45b9-9d09-d81b01763d0a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:00.599203 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.wsgi [None req-5a352db1-15ab-45b9-9d09-d81b01763d0a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] HTTP exception thrown: Instance a45e219e-e492-44d7-a962-1a741b0abcaa could not be found. Jun 23 13:45:00.601122 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-5a352db1-15ab-45b9-9d09-d81b01763d0a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Request method failure captured: Jun 23 13:45:00.601122 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: request: GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa HTTP/1.1 Jun 23 13:45:00.601122 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept: application/json Jun 23 13:45:00.601122 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept-Encoding: identity Jun 23 13:45:00.601122 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Connection: close Jun 23 13:45:00.601122 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Length: 0 Jun 23 13:45:00.601122 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Type: application/json Jun 23 13:45:00.601122 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Host: 10.222.0.26 Jun 23 13:45:00.601122 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Openstack-System-Scope: None Jun 23 13:45:00.601122 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: User-Agent: python-urllib3/1.26.9 Jun 23 13:45:00.601122 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Auth-Token: gAAAAABitG0Sk3ITYqPOix6d-yn0tfx-OSIDvIuV7UJjc74SbWZgVnKUDm8nfkPPw_HDdmKI8sNR-ZRrPiM2VFS2aGUijneFicZmaRheJVdwbvopsixSQO0yPOZxFVs3fvoZ2ibh1WvoqBrlfRHbN7g-Iz0o0UFhet-npHvAovII03AWNWb9zgg Jun 23 13:45:00.601122 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Id: None Jun 23 13:45:00.601122 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Name: None Jun 23 13:45:00.601122 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Identity-Status: Confirmed Jun 23 13:45:00.601122 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Is-Admin-Project: True Jun 23 13:45:00.601122 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Id: default Jun 23 13:45:00.601122 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Name: Default Jun 23 13:45:00.601122 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Id: 855cb6e79485414ab0f2a40162231d72 Jun 23 13:45:00.601122 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-140294951 Jun 23 13:45:00.601122 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Role: member,reader Jun 23 13:45:00.601122 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Roles: member,reader Jun 23 13:45:00.602695 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/855cb6e79485414ab0f2a40162231d72"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/855cb6e79485414ab0f2a40162231d72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/855cb6e79485414ab0f2a40162231d72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_855cb6e79485414ab0f2a40162231d72", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:45:00.602695 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant: tempest-ServerRescueNegativeTestJSON-140294951 Jun 23 13:45:00.602695 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Id: 855cb6e79485414ab0f2a40162231d72 Jun 23 13:45:00.602695 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-140294951 Jun 23 13:45:00.602695 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User: tempest-ServerRescueNegativeTestJSON-140294951-project Jun 23 13:45:00.602695 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Id: default Jun 23 13:45:00.602695 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Name: Default Jun 23 13:45:00.602695 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Id: ae510389cfc04a0cb4e6991df2a93a00 Jun 23 13:45:00.602695 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Name: tempest-ServerRescueNegativeTestJSON-140294951-project Jun 23 13:45:00.602695 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: method: > Jun 23 13:45:00.602695 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: exception: Instance a45e219e-e492-44d7-a962-1a741b0abcaa could not be found. Jun 23 13:45:00.602695 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: action_args: {'id': 'a45e219e-e492-44d7-a962-1a741b0abcaa'} Jun 23 13:45:00.603798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:45:00.603798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:45:00.603798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:45:00.603798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:45:00.603798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:45:00.603798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:45:00.603798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:45:00.603798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:45:00.603798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:45:00.603798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:45:00.603798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a45e219e-e492-44d7-a962-1a741b0abcaa could not be found. Jun 23 13:45:00.603798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:45:00.603798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:45:00.603798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:45:00.603798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:45:00.603798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:45:00.603798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:45:00.603798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:45:00.603798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:45:00.603798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:45:00.605926 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:45:00.605926 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:45:00.605926 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:45:00.605926 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:45:00.605926 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:45:00.605926 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:45:00.605926 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:45:00.605926 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a45e219e-e492-44d7-a962-1a741b0abcaa could not be found. Jun 23 13:45:00.605926 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:45:00.605926 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:45:00.605926 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:45:00.605926 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:45:00.605926 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:45:00.605926 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:45:00.605926 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:45:00.605926 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:45:00.605926 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a45e219e-e492-44d7-a962-1a741b0abcaa could not be found. Jun 23 13:45:00.605926 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:45:00.607304 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-5a352db1-15ab-45b9-9d09-d81b01763d0a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Returning 404 to user: Instance a45e219e-e492-44d7-a962-1a741b0abcaa could not be found. {{(pid=134666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:45:00.607304 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-5a352db1-15ab-45b9-9d09-d81b01763d0a tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa" status: 404 len: 111 microversion: 2.1 time: 0.032400 Jun 23 13:45:00.607887 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 359/729] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:45:00 2022] GET /compute/v2.1/servers/a45e219e-e492-44d7-a962-1a741b0abcaa => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 13:45:00.612717 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-8d403655-010b-435a-ae46-c9436de9bc47 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:00.613304 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-8d403655-010b-435a-ae46-c9436de9bc47 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:00.619570 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8d403655-010b-435a-ae46-c9436de9bc47 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:00.620020 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8d403655-010b-435a-ae46-c9436de9bc47 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:00.620865 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8d403655-010b-435a-ae46-c9436de9bc47 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:00.621294 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8d403655-010b-435a-ae46-c9436de9bc47 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:00.645834 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-8d403655-010b-435a-ae46-c9436de9bc47 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Going to try to terminate instance {{(pid=134667) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 13:45:00.658641 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:00.723860 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-8d403655-010b-435a-ae46-c9436de9bc47 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29" status: 204 len: 0 microversion: 2.1 time: 0.114887 Jun 23 13:45:00.724509 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 371/730] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Jun 23 13:45:00 2022] DELETE /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 13:45:00.732954 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-35d0e573-724b-499c-9bc6-a319a238d06f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:00.733561 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-35d0e573-724b-499c-9bc6-a319a238d06f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:00.739590 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-35d0e573-724b-499c-9bc6-a319a238d06f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:00.740043 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-35d0e573-724b-499c-9bc6-a319a238d06f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:00.740803 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-35d0e573-724b-499c-9bc6-a319a238d06f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:00.741238 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-35d0e573-724b-499c-9bc6-a319a238d06f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:00.882511 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-35d0e573-724b-499c-9bc6-a319a238d06f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:00.890523 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-35d0e573-724b-499c-9bc6-a319a238d06f tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29" status: 200 len: 1521 microversion: 2.1 time: 0.161448 Jun 23 13:45:00.891457 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 360/731] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:45:00 2022] GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:45:01.592260 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-47763a33-cdec-4f5c-b105-f25b62d8c66b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:01.593312 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-47763a33-cdec-4f5c-b105-f25b62d8c66b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 7840b5d2-52e9-48db-95ba-af0fb4a5cb52] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:01.604220 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-47763a33-cdec-4f5c-b105-f25b62d8c66b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:01.604966 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-47763a33-cdec-4f5c-b105-f25b62d8c66b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:01.606221 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-47763a33-cdec-4f5c-b105-f25b62d8c66b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:01.606941 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-47763a33-cdec-4f5c-b105-f25b62d8c66b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:01.748270 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-47763a33-cdec-4f5c-b105-f25b62d8c66b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:01.756227 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-47763a33-cdec-4f5c-b105-f25b62d8c66b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52" status: 200 len: 1365 microversion: 2.1 time: 0.171233 Jun 23 13:45:01.756836 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 372/732] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:45:01 2022] GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:45:01.912472 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-2e364c0c-d96a-469b-8795-50347de9a682 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:01.913523 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-2e364c0c-d96a-469b-8795-50347de9a682 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:01.923715 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2e364c0c-d96a-469b-8795-50347de9a682 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:01.924456 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2e364c0c-d96a-469b-8795-50347de9a682 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:01.925701 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2e364c0c-d96a-469b-8795-50347de9a682 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:01.926423 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2e364c0c-d96a-469b-8795-50347de9a682 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:02.000363 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-ada716fa-420d-478a-a01f-dd36a3642075 req-5c267b81-ff55-4c5d-a92e-917c2fbec139 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7840b5d2-52e9-48db-95ba-af0fb4a5cb52", "tag": "babf77e6-6bb7-4c15-be55-0aff77abfe3f"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:45:02.008690 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-ada716fa-420d-478a-a01f-dd36a3642075 req-5c267b81-ff55-4c5d-a92e-917c2fbec139 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:02.009041 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-ada716fa-420d-478a-a01f-dd36a3642075 req-5c267b81-ff55-4c5d-a92e-917c2fbec139 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:02.022147 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-ada716fa-420d-478a-a01f-dd36a3642075 req-5c267b81-ff55-4c5d-a92e-917c2fbec139 service nova] Creating event network-changed:babf77e6-6bb7-4c15-be55-0aff77abfe3f for instance 7840b5d2-52e9-48db-95ba-af0fb4a5cb52 on hv-cinder-81558 Jun 23 13:45:02.027158 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-ada716fa-420d-478a-a01f-dd36a3642075 req-5c267b81-ff55-4c5d-a92e-917c2fbec139 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030513 Jun 23 13:45:02.027767 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 373/733] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:45:02.062727 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-2e364c0c-d96a-469b-8795-50347de9a682 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:02.070340 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-2e364c0c-d96a-469b-8795-50347de9a682 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29" status: 200 len: 1521 microversion: 2.1 time: 0.165297 Jun 23 13:45:02.070904 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 361/734] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:45:01 2022] GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:45:02.778151 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-905783eb-04d5-4cd8-aaa7-641f4401a387 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:02.779283 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-905783eb-04d5-4cd8-aaa7-641f4401a387 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 7840b5d2-52e9-48db-95ba-af0fb4a5cb52] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:02.786472 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-905783eb-04d5-4cd8-aaa7-641f4401a387 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:02.786916 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-905783eb-04d5-4cd8-aaa7-641f4401a387 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:02.787696 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-905783eb-04d5-4cd8-aaa7-641f4401a387 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:02.788121 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-905783eb-04d5-4cd8-aaa7-641f4401a387 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:02.923659 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-905783eb-04d5-4cd8-aaa7-641f4401a387 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:02.934896 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-905783eb-04d5-4cd8-aaa7-641f4401a387 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52" status: 200 len: 1365 microversion: 2.1 time: 0.164348 Jun 23 13:45:02.935702 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 374/735] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:45:02 2022] GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:45:03.091396 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-5ab3deff-2877-4636-810f-65e07d24ebfc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:03.092629 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-5ab3deff-2877-4636-810f-65e07d24ebfc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:03.102955 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5ab3deff-2877-4636-810f-65e07d24ebfc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:03.103837 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5ab3deff-2877-4636-810f-65e07d24ebfc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:03.105556 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5ab3deff-2877-4636-810f-65e07d24ebfc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:03.106283 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5ab3deff-2877-4636-810f-65e07d24ebfc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:03.237591 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-5ab3deff-2877-4636-810f-65e07d24ebfc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:03.244971 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-5ab3deff-2877-4636-810f-65e07d24ebfc tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29" status: 200 len: 1521 microversion: 2.1 time: 0.160011 Jun 23 13:45:03.245767 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 362/736] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:45:03 2022] GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:45:03.952483 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-17a56419-6e58-4c6b-b6d4-eb44391dc3e8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:03.953056 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-17a56419-6e58-4c6b-b6d4-eb44391dc3e8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 7840b5d2-52e9-48db-95ba-af0fb4a5cb52] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:03.960820 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-17a56419-6e58-4c6b-b6d4-eb44391dc3e8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:03.961301 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-17a56419-6e58-4c6b-b6d4-eb44391dc3e8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:03.962059 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-17a56419-6e58-4c6b-b6d4-eb44391dc3e8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:03.962493 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-17a56419-6e58-4c6b-b6d4-eb44391dc3e8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:04.095593 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-17a56419-6e58-4c6b-b6d4-eb44391dc3e8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:04.103193 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-17a56419-6e58-4c6b-b6d4-eb44391dc3e8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52" status: 200 len: 1365 microversion: 2.1 time: 0.154639 Jun 23 13:45:04.103860 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 375/737] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:45:03 2022] GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:45:04.228858 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-877ba153-c65d-4393-8370-ca52426e8b2a req-78c1219e-cdbf-4b59-9d70-978175ea988e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee2cdaf7-cefe-4877-b855-b4646b50cf29", "name": "network-vif-deleted", "tag": "fff37344-1345-4e9c-9d02-4e0e47f479fc"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:45:04.237468 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-877ba153-c65d-4393-8370-ca52426e8b2a req-78c1219e-cdbf-4b59-9d70-978175ea988e service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:04.237917 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-877ba153-c65d-4393-8370-ca52426e8b2a req-78c1219e-cdbf-4b59-9d70-978175ea988e service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:04.249067 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-877ba153-c65d-4393-8370-ca52426e8b2a req-78c1219e-cdbf-4b59-9d70-978175ea988e service nova] Creating event network-vif-deleted:fff37344-1345-4e9c-9d02-4e0e47f479fc for instance ee2cdaf7-cefe-4877-b855-b4646b50cf29 on hv-cinder-81558 Jun 23 13:45:04.254567 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-877ba153-c65d-4393-8370-ca52426e8b2a req-78c1219e-cdbf-4b59-9d70-978175ea988e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029332 Jun 23 13:45:04.255161 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 363/738] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:45:04.260776 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-56bd31cb-2f98-4e4e-99d1-22d2d243ce35 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:04.261391 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-56bd31cb-2f98-4e4e-99d1-22d2d243ce35 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:04.267504 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-56bd31cb-2f98-4e4e-99d1-22d2d243ce35 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:04.267959 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-56bd31cb-2f98-4e4e-99d1-22d2d243ce35 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:04.268716 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-56bd31cb-2f98-4e4e-99d1-22d2d243ce35 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:04.269151 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-56bd31cb-2f98-4e4e-99d1-22d2d243ce35 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:04.329927 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-56bd31cb-2f98-4e4e-99d1-22d2d243ce35 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:04.337985 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-56bd31cb-2f98-4e4e-99d1-22d2d243ce35 tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29" status: 200 len: 1479 microversion: 2.1 time: 0.081066 Jun 23 13:45:04.338550 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 376/739] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:45:04 2022] GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29 => generated 1479 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:45:05.121100 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-231fc0ef-247b-48aa-8e6e-181ad20929a0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:05.121961 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-231fc0ef-247b-48aa-8e6e-181ad20929a0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 7840b5d2-52e9-48db-95ba-af0fb4a5cb52] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:05.129309 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-231fc0ef-247b-48aa-8e6e-181ad20929a0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:05.129906 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-231fc0ef-247b-48aa-8e6e-181ad20929a0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:05.130845 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-231fc0ef-247b-48aa-8e6e-181ad20929a0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:05.131472 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-231fc0ef-247b-48aa-8e6e-181ad20929a0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:05.265896 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-231fc0ef-247b-48aa-8e6e-181ad20929a0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:05.273745 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-231fc0ef-247b-48aa-8e6e-181ad20929a0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52" status: 200 len: 1365 microversion: 2.1 time: 0.157062 Jun 23 13:45:05.274292 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 364/740] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:45:05 2022] GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:45:05.357975 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-953f5772-52c4-4787-b3bd-a432d74fa2fb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:05.358921 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-953f5772-52c4-4787-b3bd-a432d74fa2fb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:05.367004 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-953f5772-52c4-4787-b3bd-a432d74fa2fb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:05.367568 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-953f5772-52c4-4787-b3bd-a432d74fa2fb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:05.368455 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-953f5772-52c4-4787-b3bd-a432d74fa2fb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:05.368962 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-953f5772-52c4-4787-b3bd-a432d74fa2fb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:05.398103 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:05.403369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-953f5772-52c4-4787-b3bd-a432d74fa2fb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:05.403836 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-953f5772-52c4-4787-b3bd-a432d74fa2fb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:05.404278 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.objects.instance [None req-953f5772-52c4-4787-b3bd-a432d74fa2fb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lazy-loading 'fault' on Instance uuid ee2cdaf7-cefe-4877-b855-b4646b50cf29 {{(pid=134667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:45:05.448905 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-953f5772-52c4-4787-b3bd-a432d74fa2fb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae510389cfc04a0cb4e6991df2a93a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855cb6e79485414ab0f2a40162231d72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:05.456603 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-953f5772-52c4-4787-b3bd-a432d74fa2fb tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29" status: 200 len: 1312 microversion: 2.1 time: 0.105207 Jun 23 13:45:05.457538 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 377/741] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:45:05 2022] GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29 => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:45:06.299014 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-db77380b-ce62-4de4-9983-3f267e393e16 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:06.299781 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-db77380b-ce62-4de4-9983-3f267e393e16 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 7840b5d2-52e9-48db-95ba-af0fb4a5cb52] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:06.306901 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-db77380b-ce62-4de4-9983-3f267e393e16 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:06.307393 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-db77380b-ce62-4de4-9983-3f267e393e16 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:06.308156 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-db77380b-ce62-4de4-9983-3f267e393e16 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:06.308597 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-db77380b-ce62-4de4-9983-3f267e393e16 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:06.452644 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-db77380b-ce62-4de4-9983-3f267e393e16 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:06.464052 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-db77380b-ce62-4de4-9983-3f267e393e16 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52" status: 200 len: 1365 microversion: 2.1 time: 0.170656 Jun 23 13:45:06.464670 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 365/742] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:45:06 2022] GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:45:06.474074 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-94be3a9a-48f9-4035-b7a2-f0c3c61b1d5e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:06.474763 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-94be3a9a-48f9-4035-b7a2-f0c3c61b1d5e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] [instance: ee2cdaf7-cefe-4877-b855-b4646b50cf29] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:06.481429 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-94be3a9a-48f9-4035-b7a2-f0c3c61b1d5e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:06.481885 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-94be3a9a-48f9-4035-b7a2-f0c3c61b1d5e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:06.482643 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-94be3a9a-48f9-4035-b7a2-f0c3c61b1d5e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:06.483116 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-94be3a9a-48f9-4035-b7a2-f0c3c61b1d5e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:06.496299 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.wsgi [None req-94be3a9a-48f9-4035-b7a2-f0c3c61b1d5e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] HTTP exception thrown: Instance ee2cdaf7-cefe-4877-b855-b4646b50cf29 could not be found. Jun 23 13:45:06.497899 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-94be3a9a-48f9-4035-b7a2-f0c3c61b1d5e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Request method failure captured: Jun 23 13:45:06.497899 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29 HTTP/1.1 Jun 23 13:45:06.497899 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:45:06.497899 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:45:06.497899 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:45:06.497899 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 0 Jun 23 13:45:06.497899 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:45:06.497899 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:45:06.497899 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:45:06.497899 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:45:06.497899 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitG0Sk3ITYqPOix6d-yn0tfx-OSIDvIuV7UJjc74SbWZgVnKUDm8nfkPPw_HDdmKI8sNR-ZRrPiM2VFS2aGUijneFicZmaRheJVdwbvopsixSQO0yPOZxFVs3fvoZ2ibh1WvoqBrlfRHbN7g-Iz0o0UFhet-npHvAovII03AWNWb9zgg Jun 23 13:45:06.497899 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:45:06.497899 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:45:06.497899 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:45:06.497899 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:45:06.497899 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:45:06.497899 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:45:06.497899 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: 855cb6e79485414ab0f2a40162231d72 Jun 23 13:45:06.497899 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-140294951 Jun 23 13:45:06.497899 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:45:06.497899 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:45:06.499581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/855cb6e79485414ab0f2a40162231d72"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/855cb6e79485414ab0f2a40162231d72"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/855cb6e79485414ab0f2a40162231d72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_855cb6e79485414ab0f2a40162231d72", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:45:06.499581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-ServerRescueNegativeTestJSON-140294951 Jun 23 13:45:06.499581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: 855cb6e79485414ab0f2a40162231d72 Jun 23 13:45:06.499581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-140294951 Jun 23 13:45:06.499581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-ServerRescueNegativeTestJSON-140294951-project Jun 23 13:45:06.499581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:45:06.499581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:45:06.499581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: ae510389cfc04a0cb4e6991df2a93a00 Jun 23 13:45:06.499581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-ServerRescueNegativeTestJSON-140294951-project Jun 23 13:45:06.499581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: > Jun 23 13:45:06.499581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Instance ee2cdaf7-cefe-4877-b855-b4646b50cf29 could not be found. Jun 23 13:45:06.499581 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'id': 'ee2cdaf7-cefe-4877-b855-b4646b50cf29'} Jun 23 13:45:06.500380 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:45:06.500380 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:45:06.500380 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:45:06.500380 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:45:06.500380 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:45:06.500380 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:45:06.500380 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:45:06.500380 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:45:06.500380 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:45:06.500380 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:45:06.500380 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee2cdaf7-cefe-4877-b855-b4646b50cf29 could not be found. Jun 23 13:45:06.500380 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:45:06.500380 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:45:06.500380 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:45:06.500380 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:45:06.500380 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:45:06.500380 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:45:06.500380 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:45:06.500380 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:45:06.500380 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:45:06.501613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:45:06.501613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:45:06.501613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:45:06.501613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:45:06.501613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:45:06.501613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:45:06.501613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:45:06.501613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee2cdaf7-cefe-4877-b855-b4646b50cf29 could not be found. Jun 23 13:45:06.501613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:45:06.501613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:45:06.501613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:45:06.501613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:45:06.501613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:45:06.501613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:45:06.501613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:45:06.501613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:45:06.501613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee2cdaf7-cefe-4877-b855-b4646b50cf29 could not be found. Jun 23 13:45:06.501613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:45:06.502718 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-94be3a9a-48f9-4035-b7a2-f0c3c61b1d5e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] Returning 404 to user: Instance ee2cdaf7-cefe-4877-b855-b4646b50cf29 could not be found. {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:45:06.502718 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-94be3a9a-48f9-4035-b7a2-f0c3c61b1d5e tempest-ServerRescueNegativeTestJSON-140294951 tempest-ServerRescueNegativeTestJSON-140294951-project] 10.222.0.26 "GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29" status: 404 len: 111 microversion: 2.1 time: 0.029122 Jun 23 13:45:06.502718 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 378/743] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:45:06 2022] GET /compute/v2.1/servers/ee2cdaf7-cefe-4877-b855-b4646b50cf29 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:45:07.481639 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-4a57e65f-2b4c-41d5-9778-0ae37b4aaf57 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:07.482228 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-4a57e65f-2b4c-41d5-9778-0ae37b4aaf57 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 7840b5d2-52e9-48db-95ba-af0fb4a5cb52] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:07.490689 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4a57e65f-2b4c-41d5-9778-0ae37b4aaf57 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:07.490689 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4a57e65f-2b4c-41d5-9778-0ae37b4aaf57 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:07.492015 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4a57e65f-2b4c-41d5-9778-0ae37b4aaf57 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:07.492015 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4a57e65f-2b4c-41d5-9778-0ae37b4aaf57 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:07.621847 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-bfbc9574-26a2-4ad2-8a5c-c1c62c972625 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:07.622384 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-bfbc9574-26a2-4ad2-8a5c-c1c62c972625 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:07.628756 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bfbc9574-26a2-4ad2-8a5c-c1c62c972625 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:07.630003 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bfbc9574-26a2-4ad2-8a5c-c1c62c972625 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:07.630842 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bfbc9574-26a2-4ad2-8a5c-c1c62c972625 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:07.631374 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bfbc9574-26a2-4ad2-8a5c-c1c62c972625 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:07.646947 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-4a57e65f-2b4c-41d5-9778-0ae37b4aaf57 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:07.655722 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-4a57e65f-2b4c-41d5-9778-0ae37b4aaf57 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52" status: 200 len: 1365 microversion: 2.1 time: 0.177834 Jun 23 13:45:07.659733 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-bfbc9574-26a2-4ad2-8a5c-c1c62c972625 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7/ips" status: 200 len: 151 microversion: 2.20 time: 0.175522 Jun 23 13:45:07.660275 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 379/744] 10.222.0.26 () {60 vars in 1288 bytes} [Thu Jun 23 13:45:07 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7/ips => generated 151 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 13:45:07.665997 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 366/745] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:45:07 2022] GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52 => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:45:08.673306 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-c7d754b9-6daf-48b9-b92d-d9c8f77e67ab tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:08.674611 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-c7d754b9-6daf-48b9-b92d-d9c8f77e67ab tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 7840b5d2-52e9-48db-95ba-af0fb4a5cb52] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:08.677687 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell0:SELECT=2 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:08.678496 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell0:SELECT=6 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:08.683352 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c7d754b9-6daf-48b9-b92d-d9c8f77e67ab tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:08.683925 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c7d754b9-6daf-48b9-b92d-d9c8f77e67ab tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:08.684780 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c7d754b9-6daf-48b9-b92d-d9c8f77e67ab tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:08.685391 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c7d754b9-6daf-48b9-b92d-d9c8f77e67ab tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:08.857543 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-c7d754b9-6daf-48b9-b92d-d9c8f77e67ab tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:08.869831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-c7d754b9-6daf-48b9-b92d-d9c8f77e67ab tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52" status: 200 len: 1365 microversion: 2.1 time: 0.200288 Jun 23 13:45:08.870625 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 380/746] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:45:08 2022] GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52 => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:45:09.056364 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell0:SELECT=6 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:09.133291 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-be62f61a-07ad-4668-9ce2-e7d57a4eacfd req-03c1b977-cd33-4396-9578-8f119e60e60a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7840b5d2-52e9-48db-95ba-af0fb4a5cb52", "name": "network-vif-plugged", "status": "completed", "tag": "babf77e6-6bb7-4c15-be55-0aff77abfe3f"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:45:09.141542 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-be62f61a-07ad-4668-9ce2-e7d57a4eacfd req-03c1b977-cd33-4396-9578-8f119e60e60a service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:09.141989 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-be62f61a-07ad-4668-9ce2-e7d57a4eacfd req-03c1b977-cd33-4396-9578-8f119e60e60a service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:09.153168 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-be62f61a-07ad-4668-9ce2-e7d57a4eacfd req-03c1b977-cd33-4396-9578-8f119e60e60a service nova] Creating event network-vif-plugged:babf77e6-6bb7-4c15-be55-0aff77abfe3f for instance 7840b5d2-52e9-48db-95ba-af0fb4a5cb52 on hv-cinder-81558 Jun 23 13:45:09.158570 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-be62f61a-07ad-4668-9ce2-e7d57a4eacfd req-03c1b977-cd33-4396-9578-8f119e60e60a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107385 Jun 23 13:45:09.159169 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 367/747] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:45:09.887367 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-8320fa08-1275-4f51-b6c5-b785b82c9358 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:09.889777 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-8320fa08-1275-4f51-b6c5-b785b82c9358 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 7840b5d2-52e9-48db-95ba-af0fb4a5cb52] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:09.907172 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8320fa08-1275-4f51-b6c5-b785b82c9358 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:09.907647 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8320fa08-1275-4f51-b6c5-b785b82c9358 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:09.908417 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8320fa08-1275-4f51-b6c5-b785b82c9358 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:09.908850 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8320fa08-1275-4f51-b6c5-b785b82c9358 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:10.051697 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-8320fa08-1275-4f51-b6c5-b785b82c9358 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:10.059516 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-8320fa08-1275-4f51-b6c5-b785b82c9358 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52" status: 200 len: 1365 microversion: 2.1 time: 0.176076 Jun 23 13:45:10.060125 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 381/748] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:45:09 2022] GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:45:10.127424 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-4886a193-64dc-446d-9f77-8beef73b90a3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:45:10.128039 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-4886a193-64dc-446d-9f77-8beef73b90a3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:10.134133 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4886a193-64dc-446d-9f77-8beef73b90a3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:10.134577 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4886a193-64dc-446d-9f77-8beef73b90a3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:10.135327 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4886a193-64dc-446d-9f77-8beef73b90a3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:10.135793 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4886a193-64dc-446d-9f77-8beef73b90a3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:10.160197 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.objects.instance [None req-4886a193-64dc-446d-9f77-8beef73b90a3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lazy-loading 'flavor' on Instance uuid a602a74c-fbf6-4ed0-85c6-f1778d879da7 {{(pid=134666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:45:10.422534 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-4886a193-64dc-446d-9f77-8beef73b90a3 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "POST /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7/action" status: 202 len: 0 microversion: 2.20 time: 0.299759 Jun 23 13:45:10.423359 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 368/749] 10.222.0.26 () {62 vars in 1318 bytes} [Thu Jun 23 13:45:10 2022] POST /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 13:45:10.432548 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-66a35ec2-1390-4c11-b98c-b0740567b9b1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:10.433116 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-66a35ec2-1390-4c11-b98c-b0740567b9b1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:10.440080 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-66a35ec2-1390-4c11-b98c-b0740567b9b1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:10.440530 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-66a35ec2-1390-4c11-b98c-b0740567b9b1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:10.441352 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-66a35ec2-1390-4c11-b98c-b0740567b9b1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:10.441845 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-66a35ec2-1390-4c11-b98c-b0740567b9b1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:10.579064 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-66a35ec2-1390-4c11-b98c-b0740567b9b1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:10.585584 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-66a35ec2-1390-4c11-b98c-b0740567b9b1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:10.587211 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-66a35ec2-1390-4c11-b98c-b0740567b9b1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:10.588413 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-66a35ec2-1390-4c11-b98c-b0740567b9b1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1723 microversion: 2.20 time: 0.160511 Jun 23 13:45:10.588977 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 382/750] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:10 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:11.077231 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-7214a36e-aabb-46a6-a08b-aba2536484a0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:11.077924 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-7214a36e-aabb-46a6-a08b-aba2536484a0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 7840b5d2-52e9-48db-95ba-af0fb4a5cb52] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:11.085062 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7214a36e-aabb-46a6-a08b-aba2536484a0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:11.085556 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7214a36e-aabb-46a6-a08b-aba2536484a0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:11.086316 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7214a36e-aabb-46a6-a08b-aba2536484a0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:11.086768 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7214a36e-aabb-46a6-a08b-aba2536484a0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:11.220199 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-7214a36e-aabb-46a6-a08b-aba2536484a0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:11.228149 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-7214a36e-aabb-46a6-a08b-aba2536484a0 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52" status: 200 len: 1556 microversion: 2.1 time: 0.155279 Jun 23 13:45:11.228709 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 369/751] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:45:11 2022] GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52 => generated 1556 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:45:11.244412 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-93923cc7-e6de-422a-8df6-f437fd52bfe2 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:11.244911 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-93923cc7-e6de-422a-8df6-f437fd52bfe2 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 7840b5d2-52e9-48db-95ba-af0fb4a5cb52] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:11.251469 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-93923cc7-e6de-422a-8df6-f437fd52bfe2 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:11.251917 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-93923cc7-e6de-422a-8df6-f437fd52bfe2 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:11.252671 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-93923cc7-e6de-422a-8df6-f437fd52bfe2 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:11.253109 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-93923cc7-e6de-422a-8df6-f437fd52bfe2 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:11.345232 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-93923cc7-e6de-422a-8df6-f437fd52bfe2 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104635 Jun 23 13:45:11.345845 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 383/752] 10.222.0.26 () {58 vars in 1274 bytes} [Thu Jun 23 13:45:11 2022] GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 13:45:11.612080 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-075f4265-cca6-40ad-97e5-6ec8c91e445b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:11.613069 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-075f4265-cca6-40ad-97e5-6ec8c91e445b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:11.619436 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-075f4265-cca6-40ad-97e5-6ec8c91e445b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:11.619893 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-075f4265-cca6-40ad-97e5-6ec8c91e445b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:11.620663 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-075f4265-cca6-40ad-97e5-6ec8c91e445b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:11.621109 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-075f4265-cca6-40ad-97e5-6ec8c91e445b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:11.772660 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-075f4265-cca6-40ad-97e5-6ec8c91e445b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:11.781598 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-075f4265-cca6-40ad-97e5-6ec8c91e445b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:11.783796 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-075f4265-cca6-40ad-97e5-6ec8c91e445b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:11.785315 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-075f4265-cca6-40ad-97e5-6ec8c91e445b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1723 microversion: 2.20 time: 0.181935 Jun 23 13:45:11.786272 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 370/753] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:11 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:12.314963 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-4859b0d9-77c7-4db1-a105-c176693bbf24 req-ec305964-85ce-4f7f-b65f-fe6c5a0571dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7840b5d2-52e9-48db-95ba-af0fb4a5cb52", "tag": "babf77e6-6bb7-4c15-be55-0aff77abfe3f"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:45:12.323741 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-4859b0d9-77c7-4db1-a105-c176693bbf24 req-ec305964-85ce-4f7f-b65f-fe6c5a0571dd service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:12.324253 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-4859b0d9-77c7-4db1-a105-c176693bbf24 req-ec305964-85ce-4f7f-b65f-fe6c5a0571dd service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:12.336393 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-4859b0d9-77c7-4db1-a105-c176693bbf24 req-ec305964-85ce-4f7f-b65f-fe6c5a0571dd service nova] Creating event network-changed:babf77e6-6bb7-4c15-be55-0aff77abfe3f for instance 7840b5d2-52e9-48db-95ba-af0fb4a5cb52 on hv-cinder-81558 Jun 23 13:45:12.342138 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-4859b0d9-77c7-4db1-a105-c176693bbf24 req-ec305964-85ce-4f7f-b65f-fe6c5a0571dd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031523 Jun 23 13:45:12.343304 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 384/754] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:45:12.805887 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-999b6984-de82-4123-b774-2adb9efd8315 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:12.807313 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-999b6984-de82-4123-b774-2adb9efd8315 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:12.814680 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-999b6984-de82-4123-b774-2adb9efd8315 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:12.815506 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-999b6984-de82-4123-b774-2adb9efd8315 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:12.816454 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-999b6984-de82-4123-b774-2adb9efd8315 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:12.817046 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-999b6984-de82-4123-b774-2adb9efd8315 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:12.976567 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-999b6984-de82-4123-b774-2adb9efd8315 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:12.986152 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-999b6984-de82-4123-b774-2adb9efd8315 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:12.988340 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-999b6984-de82-4123-b774-2adb9efd8315 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:12.990017 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-999b6984-de82-4123-b774-2adb9efd8315 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1723 microversion: 2.20 time: 0.188247 Jun 23 13:45:13.000596 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 371/755] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:12 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:14.009862 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-04cb68b6-8907-462f-89a9-7a930690c3a9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:14.010688 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-04cb68b6-8907-462f-89a9-7a930690c3a9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:14.017201 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-04cb68b6-8907-462f-89a9-7a930690c3a9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:14.017653 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-04cb68b6-8907-462f-89a9-7a930690c3a9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:14.018412 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-04cb68b6-8907-462f-89a9-7a930690c3a9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:14.018845 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-04cb68b6-8907-462f-89a9-7a930690c3a9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:14.154190 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-04cb68b6-8907-462f-89a9-7a930690c3a9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:14.162524 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-04cb68b6-8907-462f-89a9-7a930690c3a9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:14.164189 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-04cb68b6-8907-462f-89a9-7a930690c3a9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:14.165439 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-04cb68b6-8907-462f-89a9-7a930690c3a9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1723 microversion: 2.20 time: 0.159876 Jun 23 13:45:14.166002 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 385/756] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:14 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:14.820157 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-40270416-4724-4ed4-bf27-a579c4f40020 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-999735637"}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:45:14.820722 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-40270416-4724-4ed4-bf27-a579c4f40020 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:14.823162 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:14.828658 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-40270416-4724-4ed4-bf27-a579c4f40020 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:14.829107 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-40270416-4724-4ed4-bf27-a579c4f40020 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:14.829872 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-40270416-4724-4ed4-bf27-a579c4f40020 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:14.830358 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-40270416-4724-4ed4-bf27-a579c4f40020 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:14.835646 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:14.977408 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.network.security_group_api [None req-40270416-4724-4ed4-bf27-a579c4f40020 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Removing security group 2037daa1-989f-4490-8a83-7c780e7cebde from port f801c0fd-febc-4835-97ee-811b19175e3e Jun 23 13:45:15.183784 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-5546e062-dec6-4329-b68d-e14f14b8dfcb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:15.184349 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-5546e062-dec6-4329-b68d-e14f14b8dfcb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:15.191206 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5546e062-dec6-4329-b68d-e14f14b8dfcb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:15.191689 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5546e062-dec6-4329-b68d-e14f14b8dfcb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:15.192461 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5546e062-dec6-4329-b68d-e14f14b8dfcb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:15.192899 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5546e062-dec6-4329-b68d-e14f14b8dfcb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:15.395828 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-5546e062-dec6-4329-b68d-e14f14b8dfcb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:15.404217 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-5546e062-dec6-4329-b68d-e14f14b8dfcb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:15.405818 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-5546e062-dec6-4329-b68d-e14f14b8dfcb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:15.406973 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-5546e062-dec6-4329-b68d-e14f14b8dfcb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1723 microversion: 2.20 time: 0.227277 Jun 23 13:45:15.407560 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 386/757] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:15 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:15.625384 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-40270416-4724-4ed4-bf27-a579c4f40020 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "POST /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6/action" status: 202 len: 0 microversion: 2.1 time: 0.809105 Jun 23 13:45:15.626963 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 372/758] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Jun 23 13:45:14 2022] POST /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6/action => generated 0 bytes in 811 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 13:45:15.808135 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-a4056126-19d1-4d04-b3bd-6bfda334b544 req-649291a9-aae8-4a67-8b35-8cb2c05c3436 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01f7b0a9-1671-460d-8a52-541dc119c6f6", "tag": "f801c0fd-febc-4835-97ee-811b19175e3e"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:45:15.828201 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-a4056126-19d1-4d04-b3bd-6bfda334b544 req-649291a9-aae8-4a67-8b35-8cb2c05c3436 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:15.828655 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-a4056126-19d1-4d04-b3bd-6bfda334b544 req-649291a9-aae8-4a67-8b35-8cb2c05c3436 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:15.849748 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-a4056126-19d1-4d04-b3bd-6bfda334b544 req-649291a9-aae8-4a67-8b35-8cb2c05c3436 service nova] Creating event network-changed:f801c0fd-febc-4835-97ee-811b19175e3e for instance 01f7b0a9-1671-460d-8a52-541dc119c6f6 on hv-cinder-81558 Jun 23 13:45:15.854862 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-a4056126-19d1-4d04-b3bd-6bfda334b544 req-649291a9-aae8-4a67-8b35-8cb2c05c3436 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.225299 Jun 23 13:45:15.855653 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 387/759] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:45:16.426094 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-2143d8c1-b0f8-464a-a225-b6563e55a777 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:16.426818 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-2143d8c1-b0f8-464a-a225-b6563e55a777 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:16.433098 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2143d8c1-b0f8-464a-a225-b6563e55a777 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:16.433847 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2143d8c1-b0f8-464a-a225-b6563e55a777 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:16.434696 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2143d8c1-b0f8-464a-a225-b6563e55a777 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:16.435325 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2143d8c1-b0f8-464a-a225-b6563e55a777 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:16.669212 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-2143d8c1-b0f8-464a-a225-b6563e55a777 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:16.679034 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-2143d8c1-b0f8-464a-a225-b6563e55a777 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:16.680604 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-2143d8c1-b0f8-464a-a225-b6563e55a777 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:16.681776 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-2143d8c1-b0f8-464a-a225-b6563e55a777 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1723 microversion: 2.20 time: 0.260371 Jun 23 13:45:16.683314 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 373/760] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:16 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:16.839362 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-de3bffa2-456c-4a42-be00-590a8c770dc4 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:16.839992 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-de3bffa2-456c-4a42-be00-590a8c770dc4 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:16.846504 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-de3bffa2-456c-4a42-be00-590a8c770dc4 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:16.846966 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-de3bffa2-456c-4a42-be00-590a8c770dc4 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:16.847745 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-de3bffa2-456c-4a42-be00-590a8c770dc4 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:16.848185 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-de3bffa2-456c-4a42-be00-590a8c770dc4 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:16.930302 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.objects.instance [None req-de3bffa2-456c-4a42-be00-590a8c770dc4 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lazy-loading 'services' on Instance uuid 01f7b0a9-1671-460d-8a52-541dc119c6f6 {{(pid=134667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:45:17.004491 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-de3bffa2-456c-4a42-be00-590a8c770dc4 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "DELETE /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6/os-volume_attachments/2aba6908-ec73-4663-837e-033a1d100183" status: 202 len: 0 microversion: 2.1 time: 0.169775 Jun 23 13:45:17.008389 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 388/761] 10.222.0.26 () {58 vars in 1415 bytes} [Thu Jun 23 13:45:16 2022] DELETE /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6/os-volume_attachments/2aba6908-ec73-4663-837e-033a1d100183 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 13:45:17.014369 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-9a2f0c8d-69de-44ca-9f2e-15dd286a9d32 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:17.015367 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-9a2f0c8d-69de-44ca-9f2e-15dd286a9d32 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:17.021687 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9a2f0c8d-69de-44ca-9f2e-15dd286a9d32 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:17.022303 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9a2f0c8d-69de-44ca-9f2e-15dd286a9d32 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:17.023157 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9a2f0c8d-69de-44ca-9f2e-15dd286a9d32 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:17.023827 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9a2f0c8d-69de-44ca-9f2e-15dd286a9d32 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:17.056262 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-9a2f0c8d-69de-44ca-9f2e-15dd286a9d32 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046631 Jun 23 13:45:17.061369 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 374/762] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Jun 23 13:45:17 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:45:17.701822 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-6979b201-25cb-4887-906e-ae57f9b37d90 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:17.702480 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-6979b201-25cb-4887-906e-ae57f9b37d90 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:17.709561 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6979b201-25cb-4887-906e-ae57f9b37d90 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:17.710204 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6979b201-25cb-4887-906e-ae57f9b37d90 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:17.711006 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6979b201-25cb-4887-906e-ae57f9b37d90 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:17.711521 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6979b201-25cb-4887-906e-ae57f9b37d90 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:17.731924 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:17.906937 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-7f912327-bbda-4e52-9908-74e9d6145ac3 req-7d17bf99-602a-4c13-af37-803e7ee4a877 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01f7b0a9-1671-460d-8a52-541dc119c6f6", "tag": "f801c0fd-febc-4835-97ee-811b19175e3e"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:45:17.918869 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-7f912327-bbda-4e52-9908-74e9d6145ac3 req-7d17bf99-602a-4c13-af37-803e7ee4a877 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:17.919786 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-7f912327-bbda-4e52-9908-74e9d6145ac3 req-7d17bf99-602a-4c13-af37-803e7ee4a877 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:17.920931 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-6979b201-25cb-4887-906e-ae57f9b37d90 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:17.930559 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-6979b201-25cb-4887-906e-ae57f9b37d90 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:17.932095 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-6979b201-25cb-4887-906e-ae57f9b37d90 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:17.933730 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-6979b201-25cb-4887-906e-ae57f9b37d90 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1723 microversion: 2.20 time: 0.236316 Jun 23 13:45:17.935381 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 389/763] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:17 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:17.936541 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-7f912327-bbda-4e52-9908-74e9d6145ac3 req-7d17bf99-602a-4c13-af37-803e7ee4a877 service nova] Creating event network-changed:f801c0fd-febc-4835-97ee-811b19175e3e for instance 01f7b0a9-1671-460d-8a52-541dc119c6f6 on hv-cinder-81558 Jun 23 13:45:17.948504 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-7f912327-bbda-4e52-9908-74e9d6145ac3 req-7d17bf99-602a-4c13-af37-803e7ee4a877 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046508 Jun 23 13:45:17.949208 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 375/764] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:45:18.069001 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-bbbba168-d411-4b3c-8dbf-86ecb2e609cd tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:18.070299 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-bbbba168-d411-4b3c-8dbf-86ecb2e609cd tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:18.076875 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bbbba168-d411-4b3c-8dbf-86ecb2e609cd tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:18.077598 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bbbba168-d411-4b3c-8dbf-86ecb2e609cd tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:18.078448 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bbbba168-d411-4b3c-8dbf-86ecb2e609cd tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:18.079117 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bbbba168-d411-4b3c-8dbf-86ecb2e609cd tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:18.115291 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-bbbba168-d411-4b3c-8dbf-86ecb2e609cd tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050276 Jun 23 13:45:18.115918 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 390/765] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Jun 23 13:45:18 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 23 13:45:18.128013 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-75dcc953-938a-460e-a503-b2d1dd24fe0f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:18.128543 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-75dcc953-938a-460e-a503-b2d1dd24fe0f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:18.135142 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-75dcc953-938a-460e-a503-b2d1dd24fe0f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:18.135693 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-75dcc953-938a-460e-a503-b2d1dd24fe0f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:18.136688 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-75dcc953-938a-460e-a503-b2d1dd24fe0f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:18.137325 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-75dcc953-938a-460e-a503-b2d1dd24fe0f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:18.237260 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.wsgi [None req-75dcc953-938a-460e-a503-b2d1dd24fe0f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] HTTP exception thrown: Instance 01f7b0a9-1671-460d-8a52-541dc119c6f6 is not attached to volume 2aba6908-ec73-4663-837e-033a1d100183 Jun 23 13:45:18.239688 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-75dcc953-938a-460e-a503-b2d1dd24fe0f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Request method failure captured: Jun 23 13:45:18.239688 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: request: DELETE /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6/os-volume_attachments/2aba6908-ec73-4663-837e-033a1d100183 HTTP/1.1 Jun 23 13:45:18.239688 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept: application/json Jun 23 13:45:18.239688 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept-Encoding: identity Jun 23 13:45:18.239688 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Connection: close Jun 23 13:45:18.239688 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Length: 0 Jun 23 13:45:18.239688 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Type: application/json Jun 23 13:45:18.239688 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Host: 10.222.0.26 Jun 23 13:45:18.239688 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Openstack-System-Scope: None Jun 23 13:45:18.239688 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: User-Agent: python-urllib3/1.26.9 Jun 23 13:45:18.239688 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Auth-Token: gAAAAABitG2_7YrxXqbzDwmI9yZ7SxEuIQzs1-lXMLRUFHOZayf_svycuCtJio8K9335G2sPcm2mJ1Ed3xAW1LKPnwcL9yLvYmrP6xEfNpJmY2pKNd-l69-90SKZa5U_mmk55cACD-hiuYlVbsmPEmXylyXsaYN35W4vwdY7pIlgPxGEtXkOtWA Jun 23 13:45:18.239688 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Id: None Jun 23 13:45:18.239688 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Name: None Jun 23 13:45:18.239688 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Identity-Status: Confirmed Jun 23 13:45:18.239688 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Is-Admin-Project: True Jun 23 13:45:18.239688 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Id: default Jun 23 13:45:18.239688 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Name: Default Jun 23 13:45:18.239688 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Id: 28b455b8dd8b4910803ac509413a97e6 Jun 23 13:45:18.239688 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Name: tempest-TestMinimumBasicScenario-954876093 Jun 23 13:45:18.239688 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Role: member,reader Jun 23 13:45:18.239688 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Roles: member,reader Jun 23 13:45:18.241012 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/28b455b8dd8b4910803ac509413a97e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/28b455b8dd8b4910803ac509413a97e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/28b455b8dd8b4910803ac509413a97e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_28b455b8dd8b4910803ac509413a97e6", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:45:18.241012 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant: tempest-TestMinimumBasicScenario-954876093 Jun 23 13:45:18.241012 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Id: 28b455b8dd8b4910803ac509413a97e6 Jun 23 13:45:18.241012 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Name: tempest-TestMinimumBasicScenario-954876093 Jun 23 13:45:18.241012 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User: tempest-TestMinimumBasicScenario-954876093-project Jun 23 13:45:18.241012 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Id: default Jun 23 13:45:18.241012 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Name: Default Jun 23 13:45:18.241012 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Id: 157d5f6570024c468db34ae0ca7ad622 Jun 23 13:45:18.241012 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Name: tempest-TestMinimumBasicScenario-954876093-project Jun 23 13:45:18.241012 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: method: > Jun 23 13:45:18.241012 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: exception: Instance 01f7b0a9-1671-460d-8a52-541dc119c6f6 is not attached to volume 2aba6908-ec73-4663-837e-033a1d100183 Jun 23 13:45:18.241798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: action_args: {'server_id': '01f7b0a9-1671-460d-8a52-541dc119c6f6', 'id': '2aba6908-ec73-4663-837e-033a1d100183'} Jun 23 13:45:18.241798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:45:18.241798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:45:18.241798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 23 13:45:18.241798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 23 13:45:18.241798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 13:45:18.241798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 13:45:18.241798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 23 13:45:18.241798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 23 13:45:18.241798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2aba6908-ec73-4663-837e-033a1d100183. Jun 23 13:45:18.241798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:45:18.241798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:45:18.241798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:45:18.241798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:45:18.241798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:45:18.241798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:45:18.241798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:45:18.241798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:45:18.241798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:45:18.243028 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:45:18.243028 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 23 13:45:18.243028 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 23 13:45:18.243028 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01f7b0a9-1671-460d-8a52-541dc119c6f6 is not attached to volume 2aba6908-ec73-4663-837e-033a1d100183 Jun 23 13:45:18.243028 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:45:18.243028 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:45:18.243028 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:45:18.243028 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:45:18.243028 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:45:18.243028 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:45:18.243028 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:45:18.243028 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:45:18.243028 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01f7b0a9-1671-460d-8a52-541dc119c6f6 is not attached to volume 2aba6908-ec73-4663-837e-033a1d100183 Jun 23 13:45:18.243028 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:45:18.243028 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-75dcc953-938a-460e-a503-b2d1dd24fe0f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Returning 404 to user: Instance 01f7b0a9-1671-460d-8a52-541dc119c6f6 is not attached to volume 2aba6908-ec73-4663-837e-033a1d100183 {{(pid=134666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:45:18.244543 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-75dcc953-938a-460e-a503-b2d1dd24fe0f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "DELETE /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6/os-volume_attachments/2aba6908-ec73-4663-837e-033a1d100183" status: 404 len: 154 microversion: 2.1 time: 0.118088 Jun 23 13:45:18.244543 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 376/766] 10.222.0.26 () {58 vars in 1415 bytes} [Thu Jun 23 13:45:18 2022] DELETE /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6/os-volume_attachments/2aba6908-ec73-4663-837e-033a1d100183 => generated 154 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 13:45:18.953539 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-618ef76e-d1ce-4cae-9b16-1ca78595af84 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:18.954192 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-618ef76e-d1ce-4cae-9b16-1ca78595af84 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:18.962413 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-618ef76e-d1ce-4cae-9b16-1ca78595af84 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:18.962869 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-618ef76e-d1ce-4cae-9b16-1ca78595af84 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:18.963722 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-618ef76e-d1ce-4cae-9b16-1ca78595af84 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:18.964252 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-618ef76e-d1ce-4cae-9b16-1ca78595af84 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:19.100545 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-618ef76e-d1ce-4cae-9b16-1ca78595af84 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:19.109107 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-618ef76e-d1ce-4cae-9b16-1ca78595af84 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:19.110699 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-618ef76e-d1ce-4cae-9b16-1ca78595af84 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:19.111924 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-618ef76e-d1ce-4cae-9b16-1ca78595af84 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1723 microversion: 2.20 time: 0.162718 Jun 23 13:45:19.112463 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 391/767] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:18 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:19.392617 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-4eaca6c1-e59c-42de-a7ad-2e94eebc8236 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:19.393148 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-4eaca6c1-e59c-42de-a7ad-2e94eebc8236 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:19.400149 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4eaca6c1-e59c-42de-a7ad-2e94eebc8236 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:19.400584 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4eaca6c1-e59c-42de-a7ad-2e94eebc8236 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:19.401388 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4eaca6c1-e59c-42de-a7ad-2e94eebc8236 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:19.401805 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4eaca6c1-e59c-42de-a7ad-2e94eebc8236 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:19.426673 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-4eaca6c1-e59c-42de-a7ad-2e94eebc8236 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Going to try to terminate instance {{(pid=134666) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 13:45:19.504690 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-4eaca6c1-e59c-42de-a7ad-2e94eebc8236 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "DELETE /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 204 len: 0 microversion: 2.1 time: 0.115628 Jun 23 13:45:19.505172 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 377/768] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Jun 23 13:45:19 2022] DELETE /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 13:45:19.514742 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-da2179f7-1935-4500-b593-ccecc559d300 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:19.515532 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-da2179f7-1935-4500-b593-ccecc559d300 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:19.521587 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-da2179f7-1935-4500-b593-ccecc559d300 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:19.522030 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-da2179f7-1935-4500-b593-ccecc559d300 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:19.522981 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-da2179f7-1935-4500-b593-ccecc559d300 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:19.523609 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-da2179f7-1935-4500-b593-ccecc559d300 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:19.651540 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-da2179f7-1935-4500-b593-ccecc559d300 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:19.659545 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-da2179f7-1935-4500-b593-ccecc559d300 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1552 microversion: 2.1 time: 0.149780 Jun 23 13:45:19.660295 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 392/769] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:45:19 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1552 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:45:20.130785 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-03c89590-2feb-460d-b8f0-09ae155f50c1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:20.131597 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-03c89590-2feb-460d-b8f0-09ae155f50c1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:20.137989 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-03c89590-2feb-460d-b8f0-09ae155f50c1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:20.138535 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-03c89590-2feb-460d-b8f0-09ae155f50c1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:20.139424 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-03c89590-2feb-460d-b8f0-09ae155f50c1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:20.139932 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-03c89590-2feb-460d-b8f0-09ae155f50c1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:20.279791 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-03c89590-2feb-460d-b8f0-09ae155f50c1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:20.288108 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-03c89590-2feb-460d-b8f0-09ae155f50c1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:20.289612 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-03c89590-2feb-460d-b8f0-09ae155f50c1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:20.290759 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-03c89590-2feb-460d-b8f0-09ae155f50c1 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1723 microversion: 2.20 time: 0.164514 Jun 23 13:45:20.291317 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 378/770] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:20 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:20.677174 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-edee1a1a-38ee-47c7-ba32-a9dc7f8b85c5 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:20.677795 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-edee1a1a-38ee-47c7-ba32-a9dc7f8b85c5 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:20.684681 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-edee1a1a-38ee-47c7-ba32-a9dc7f8b85c5 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:20.685197 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-edee1a1a-38ee-47c7-ba32-a9dc7f8b85c5 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:20.685956 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-edee1a1a-38ee-47c7-ba32-a9dc7f8b85c5 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:20.686487 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-edee1a1a-38ee-47c7-ba32-a9dc7f8b85c5 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:20.816615 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-edee1a1a-38ee-47c7-ba32-a9dc7f8b85c5 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:20.824485 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-edee1a1a-38ee-47c7-ba32-a9dc7f8b85c5 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1552 microversion: 2.1 time: 0.151320 Jun 23 13:45:20.834200 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 393/771] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:45:20 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1552 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:45:21.309525 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-6501796c-ba41-4e96-b1fb-cbc2980240a7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:21.310131 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-6501796c-ba41-4e96-b1fb-cbc2980240a7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:21.317038 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6501796c-ba41-4e96-b1fb-cbc2980240a7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:21.317492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6501796c-ba41-4e96-b1fb-cbc2980240a7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:21.318255 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6501796c-ba41-4e96-b1fb-cbc2980240a7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:21.318690 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6501796c-ba41-4e96-b1fb-cbc2980240a7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:21.454581 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-6501796c-ba41-4e96-b1fb-cbc2980240a7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:21.462940 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-6501796c-ba41-4e96-b1fb-cbc2980240a7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:21.464465 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-6501796c-ba41-4e96-b1fb-cbc2980240a7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:21.465638 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-6501796c-ba41-4e96-b1fb-cbc2980240a7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1723 microversion: 2.20 time: 0.160140 Jun 23 13:45:21.466200 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 379/772] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:21 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:21.841334 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-ab01cc75-e8bb-40c5-a406-5a91b690fd70 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:21.842028 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-ab01cc75-e8bb-40c5-a406-5a91b690fd70 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:21.848718 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ab01cc75-e8bb-40c5-a406-5a91b690fd70 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:21.849141 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ab01cc75-e8bb-40c5-a406-5a91b690fd70 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:21.850013 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ab01cc75-e8bb-40c5-a406-5a91b690fd70 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:21.850451 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ab01cc75-e8bb-40c5-a406-5a91b690fd70 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:21.879246 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-eb61ebbe-efa8-4a4d-bfb6-4e1f87232bd4 req-130150b4-8ec9-48ca-aec6-2dc00d42a919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01f7b0a9-1671-460d-8a52-541dc119c6f6", "name": "network-vif-deleted", "tag": "f801c0fd-febc-4835-97ee-811b19175e3e"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:45:21.889214 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-eb61ebbe-efa8-4a4d-bfb6-4e1f87232bd4 req-130150b4-8ec9-48ca-aec6-2dc00d42a919 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:21.889820 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-eb61ebbe-efa8-4a4d-bfb6-4e1f87232bd4 req-130150b4-8ec9-48ca-aec6-2dc00d42a919 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:21.903577 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-eb61ebbe-efa8-4a4d-bfb6-4e1f87232bd4 req-130150b4-8ec9-48ca-aec6-2dc00d42a919 service nova] Creating event network-vif-deleted:f801c0fd-febc-4835-97ee-811b19175e3e for instance 01f7b0a9-1671-460d-8a52-541dc119c6f6 on hv-cinder-81558 Jun 23 13:45:21.909018 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-eb61ebbe-efa8-4a4d-bfb6-4e1f87232bd4 req-130150b4-8ec9-48ca-aec6-2dc00d42a919 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033380 Jun 23 13:45:21.909664 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 380/773] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:45:21.928239 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-ab01cc75-e8bb-40c5-a406-5a91b690fd70 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '157d5f6570024c468db34ae0ca7ad622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28b455b8dd8b4910803ac509413a97e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:21.937365 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-ab01cc75-e8bb-40c5-a406-5a91b690fd70 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 200 len: 1510 microversion: 2.1 time: 0.100093 Jun 23 13:45:21.938744 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 394/774] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:45:21 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 1510 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:45:22.484983 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-8770add6-556a-4015-b30c-8ef9704a6e8b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:22.485681 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-8770add6-556a-4015-b30c-8ef9704a6e8b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:22.492352 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8770add6-556a-4015-b30c-8ef9704a6e8b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:22.492803 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8770add6-556a-4015-b30c-8ef9704a6e8b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:22.493561 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8770add6-556a-4015-b30c-8ef9704a6e8b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:22.494027 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8770add6-556a-4015-b30c-8ef9704a6e8b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:22.623042 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-8770add6-556a-4015-b30c-8ef9704a6e8b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:22.631445 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-8770add6-556a-4015-b30c-8ef9704a6e8b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:22.633080 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-8770add6-556a-4015-b30c-8ef9704a6e8b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:22.634242 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-8770add6-556a-4015-b30c-8ef9704a6e8b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1723 microversion: 2.20 time: 0.154106 Jun 23 13:45:22.634805 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 381/775] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:22 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:22.954807 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-146d4912-f307-4c18-9d9b-5ef2fce68c3f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:22.955699 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-146d4912-f307-4c18-9d9b-5ef2fce68c3f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] [instance: 01f7b0a9-1671-460d-8a52-541dc119c6f6] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:22.964782 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-146d4912-f307-4c18-9d9b-5ef2fce68c3f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:22.965636 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-146d4912-f307-4c18-9d9b-5ef2fce68c3f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:22.966512 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-146d4912-f307-4c18-9d9b-5ef2fce68c3f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:22.967122 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-146d4912-f307-4c18-9d9b-5ef2fce68c3f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:22.985742 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.wsgi [None req-146d4912-f307-4c18-9d9b-5ef2fce68c3f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] HTTP exception thrown: Instance 01f7b0a9-1671-460d-8a52-541dc119c6f6 could not be found. Jun 23 13:45:22.987456 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-146d4912-f307-4c18-9d9b-5ef2fce68c3f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Request method failure captured: Jun 23 13:45:22.987456 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 HTTP/1.1 Jun 23 13:45:22.987456 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:45:22.987456 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:45:22.987456 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:45:22.987456 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 0 Jun 23 13:45:22.987456 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:45:22.987456 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:45:22.987456 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:45:22.987456 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:45:22.987456 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitG2_7YrxXqbzDwmI9yZ7SxEuIQzs1-lXMLRUFHOZayf_svycuCtJio8K9335G2sPcm2mJ1Ed3xAW1LKPnwcL9yLvYmrP6xEfNpJmY2pKNd-l69-90SKZa5U_mmk55cACD-hiuYlVbsmPEmXylyXsaYN35W4vwdY7pIlgPxGEtXkOtWA Jun 23 13:45:22.987456 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:45:22.987456 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:45:22.987456 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:45:22.987456 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:45:22.987456 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:45:22.987456 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:45:22.987456 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: 28b455b8dd8b4910803ac509413a97e6 Jun 23 13:45:22.987456 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-TestMinimumBasicScenario-954876093 Jun 23 13:45:22.987456 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:45:22.987456 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:45:22.988888 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/28b455b8dd8b4910803ac509413a97e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/28b455b8dd8b4910803ac509413a97e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/28b455b8dd8b4910803ac509413a97e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_28b455b8dd8b4910803ac509413a97e6", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:45:22.988888 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-TestMinimumBasicScenario-954876093 Jun 23 13:45:22.988888 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: 28b455b8dd8b4910803ac509413a97e6 Jun 23 13:45:22.988888 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-TestMinimumBasicScenario-954876093 Jun 23 13:45:22.988888 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-TestMinimumBasicScenario-954876093-project Jun 23 13:45:22.988888 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:45:22.988888 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:45:22.988888 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: 157d5f6570024c468db34ae0ca7ad622 Jun 23 13:45:22.988888 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-TestMinimumBasicScenario-954876093-project Jun 23 13:45:22.988888 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: > Jun 23 13:45:22.988888 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Instance 01f7b0a9-1671-460d-8a52-541dc119c6f6 could not be found. Jun 23 13:45:22.988888 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'id': '01f7b0a9-1671-460d-8a52-541dc119c6f6'} Jun 23 13:45:22.989647 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:45:22.989647 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:45:22.989647 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:45:22.989647 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:45:22.989647 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:45:22.989647 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:45:22.989647 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:45:22.989647 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:45:22.989647 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:45:22.989647 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:45:22.989647 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01f7b0a9-1671-460d-8a52-541dc119c6f6 could not be found. Jun 23 13:45:22.989647 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:45:22.989647 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:45:22.989647 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:45:22.989647 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:45:22.989647 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:45:22.989647 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:45:22.989647 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:45:22.989647 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:45:22.989647 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:45:22.990815 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:45:22.990815 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:45:22.990815 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:45:22.990815 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:45:22.990815 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:45:22.990815 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:45:22.990815 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:45:22.990815 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01f7b0a9-1671-460d-8a52-541dc119c6f6 could not be found. Jun 23 13:45:22.990815 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:45:22.990815 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:45:22.990815 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:45:22.990815 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:45:22.990815 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:45:22.990815 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:45:22.990815 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:45:22.990815 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:45:22.990815 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01f7b0a9-1671-460d-8a52-541dc119c6f6 could not be found. Jun 23 13:45:22.990815 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:45:22.991927 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-146d4912-f307-4c18-9d9b-5ef2fce68c3f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Returning 404 to user: Instance 01f7b0a9-1671-460d-8a52-541dc119c6f6 could not be found. {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:45:22.991927 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-146d4912-f307-4c18-9d9b-5ef2fce68c3f tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6" status: 404 len: 111 microversion: 2.1 time: 0.038353 Jun 23 13:45:22.991927 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 395/776] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:45:22 2022] GET /compute/v2.1/servers/01f7b0a9-1671-460d-8a52-541dc119c6f6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:45:22.998442 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-8e2def56-0dfd-4d23-8f8d-e4c5d706d716 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] Calling method '.version_select at 0x7fd772356160>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:23.016438 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-8e2def56-0dfd-4d23-8f8d-e4c5d706d716 tempest-TestMinimumBasicScenario-954876093 tempest-TestMinimumBasicScenario-954876093-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-960239118" status: 202 len: 0 microversion: 2.1 time: 0.022394 Jun 23 13:45:23.017167 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 382/777] 10.222.0.26 () {58 vars in 1268 bytes} [Thu Jun 23 13:45:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-960239118 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 13:45:23.653698 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-75a07281-6d5d-42da-a1fc-64c1e2aabffe tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:23.654645 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-75a07281-6d5d-42da-a1fc-64c1e2aabffe tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:23.661618 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-75a07281-6d5d-42da-a1fc-64c1e2aabffe tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:23.662081 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-75a07281-6d5d-42da-a1fc-64c1e2aabffe tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:23.662868 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-75a07281-6d5d-42da-a1fc-64c1e2aabffe tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:23.663307 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-75a07281-6d5d-42da-a1fc-64c1e2aabffe tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:23.831557 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-75a07281-6d5d-42da-a1fc-64c1e2aabffe tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:23.842943 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-75a07281-6d5d-42da-a1fc-64c1e2aabffe tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:23.844823 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-75a07281-6d5d-42da-a1fc-64c1e2aabffe tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:23.846345 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-75a07281-6d5d-42da-a1fc-64c1e2aabffe tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1723 microversion: 2.20 time: 0.196723 Jun 23 13:45:23.847123 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 396/778] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:23 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 13:45:24.867230 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-84df309c-c8a3-433b-be69-c492b2ea054c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:24.869777 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-84df309c-c8a3-433b-be69-c492b2ea054c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:24.877351 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-84df309c-c8a3-433b-be69-c492b2ea054c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:24.877804 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-84df309c-c8a3-433b-be69-c492b2ea054c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:24.878577 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-84df309c-c8a3-433b-be69-c492b2ea054c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:24.879179 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-84df309c-c8a3-433b-be69-c492b2ea054c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:25.037703 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-84df309c-c8a3-433b-be69-c492b2ea054c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:25.046490 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-84df309c-c8a3-433b-be69-c492b2ea054c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:25.048799 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-84df309c-c8a3-433b-be69-c492b2ea054c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:25.050214 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-84df309c-c8a3-433b-be69-c492b2ea054c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1723 microversion: 2.20 time: 0.188851 Jun 23 13:45:25.050769 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 383/779] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:24 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:26.071053 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-97a24cbe-d13c-49ca-a03b-adfee1e9e433 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:26.071870 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-97a24cbe-d13c-49ca-a03b-adfee1e9e433 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:26.078679 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-97a24cbe-d13c-49ca-a03b-adfee1e9e433 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:26.079132 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-97a24cbe-d13c-49ca-a03b-adfee1e9e433 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:26.079941 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-97a24cbe-d13c-49ca-a03b-adfee1e9e433 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:26.080382 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-97a24cbe-d13c-49ca-a03b-adfee1e9e433 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:26.245504 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-97a24cbe-d13c-49ca-a03b-adfee1e9e433 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:26.253812 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-97a24cbe-d13c-49ca-a03b-adfee1e9e433 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:26.255302 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-97a24cbe-d13c-49ca-a03b-adfee1e9e433 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:26.256506 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-97a24cbe-d13c-49ca-a03b-adfee1e9e433 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1723 microversion: 2.20 time: 0.190345 Jun 23 13:45:26.257168 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 397/780] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:26 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:27.275120 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-0d824166-13e7-4185-8d7e-3075d7ae27e4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:27.275757 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-0d824166-13e7-4185-8d7e-3075d7ae27e4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:27.282377 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0d824166-13e7-4185-8d7e-3075d7ae27e4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:27.282825 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0d824166-13e7-4185-8d7e-3075d7ae27e4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:27.283620 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0d824166-13e7-4185-8d7e-3075d7ae27e4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:27.284047 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0d824166-13e7-4185-8d7e-3075d7ae27e4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:27.421936 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-0d824166-13e7-4185-8d7e-3075d7ae27e4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:27.430371 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-0d824166-13e7-4185-8d7e-3075d7ae27e4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:27.431890 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-0d824166-13e7-4185-8d7e-3075d7ae27e4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:27.433050 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-0d824166-13e7-4185-8d7e-3075d7ae27e4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1744 microversion: 2.20 time: 0.162004 Jun 23 13:45:27.433626 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 384/781] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:27 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:28.450864 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-ec9bb4d8-9c38-4bb1-89e6-09923fa70374 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:28.451564 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-ec9bb4d8-9c38-4bb1-89e6-09923fa70374 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:28.458811 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ec9bb4d8-9c38-4bb1-89e6-09923fa70374 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:28.459255 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ec9bb4d8-9c38-4bb1-89e6-09923fa70374 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:28.460065 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ec9bb4d8-9c38-4bb1-89e6-09923fa70374 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:28.460471 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ec9bb4d8-9c38-4bb1-89e6-09923fa70374 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:28.590961 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-ec9bb4d8-9c38-4bb1-89e6-09923fa70374 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:28.607327 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-ec9bb4d8-9c38-4bb1-89e6-09923fa70374 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:28.608929 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-ec9bb4d8-9c38-4bb1-89e6-09923fa70374 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:28.610279 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-ec9bb4d8-9c38-4bb1-89e6-09923fa70374 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1744 microversion: 2.20 time: 0.163451 Jun 23 13:45:28.611181 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 398/782] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:28 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:29.632762 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-e8ab7916-3565-4776-b134-0b03fc785f82 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:29.633467 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-e8ab7916-3565-4776-b134-0b03fc785f82 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:29.640473 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e8ab7916-3565-4776-b134-0b03fc785f82 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:29.640921 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e8ab7916-3565-4776-b134-0b03fc785f82 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:29.641680 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e8ab7916-3565-4776-b134-0b03fc785f82 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:29.642104 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e8ab7916-3565-4776-b134-0b03fc785f82 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:29.776982 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-e8ab7916-3565-4776-b134-0b03fc785f82 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:29.786357 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-e8ab7916-3565-4776-b134-0b03fc785f82 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:29.788104 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-e8ab7916-3565-4776-b134-0b03fc785f82 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:29.789398 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-e8ab7916-3565-4776-b134-0b03fc785f82 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1744 microversion: 2.20 time: 0.160666 Jun 23 13:45:29.790831 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 385/783] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:29 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 13:45:30.810199 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-fb039a0a-92c8-4517-9ed4-8b53072889bd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:30.810836 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-fb039a0a-92c8-4517-9ed4-8b53072889bd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:30.818326 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fb039a0a-92c8-4517-9ed4-8b53072889bd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:30.818859 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fb039a0a-92c8-4517-9ed4-8b53072889bd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:30.819828 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fb039a0a-92c8-4517-9ed4-8b53072889bd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:30.820332 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fb039a0a-92c8-4517-9ed4-8b53072889bd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:30.954906 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-fb039a0a-92c8-4517-9ed4-8b53072889bd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:30.967166 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-fb039a0a-92c8-4517-9ed4-8b53072889bd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:30.969053 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-fb039a0a-92c8-4517-9ed4-8b53072889bd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:30.970425 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-fb039a0a-92c8-4517-9ed4-8b53072889bd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1744 microversion: 2.20 time: 0.164691 Jun 23 13:45:30.971012 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 399/784] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:30 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:31.988955 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-17c9404c-387c-4e4d-ad30-0c9daf1c2c0b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:31.990308 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-17c9404c-387c-4e4d-ad30-0c9daf1c2c0b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:31.997047 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-17c9404c-387c-4e4d-ad30-0c9daf1c2c0b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:31.997505 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-17c9404c-387c-4e4d-ad30-0c9daf1c2c0b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:31.998492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-17c9404c-387c-4e4d-ad30-0c9daf1c2c0b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:31.999082 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-17c9404c-387c-4e4d-ad30-0c9daf1c2c0b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:32.144106 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-17c9404c-387c-4e4d-ad30-0c9daf1c2c0b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:32.152861 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-17c9404c-387c-4e4d-ad30-0c9daf1c2c0b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:32.154433 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-17c9404c-387c-4e4d-ad30-0c9daf1c2c0b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:32.155788 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-17c9404c-387c-4e4d-ad30-0c9daf1c2c0b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1739 microversion: 2.20 time: 0.170777 Jun 23 13:45:32.156642 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 386/785] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:31 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:33.175914 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-84a9e8dd-1928-457a-8a6c-154d458632f4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:33.176677 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-84a9e8dd-1928-457a-8a6c-154d458632f4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:33.183058 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-84a9e8dd-1928-457a-8a6c-154d458632f4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:33.183767 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-84a9e8dd-1928-457a-8a6c-154d458632f4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:33.184713 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-84a9e8dd-1928-457a-8a6c-154d458632f4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:33.185395 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-84a9e8dd-1928-457a-8a6c-154d458632f4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:33.332624 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-84a9e8dd-1928-457a-8a6c-154d458632f4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:33.341823 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-84a9e8dd-1928-457a-8a6c-154d458632f4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:33.343631 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-84a9e8dd-1928-457a-8a6c-154d458632f4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:33.344897 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-84a9e8dd-1928-457a-8a6c-154d458632f4 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1739 microversion: 2.20 time: 0.174597 Jun 23 13:45:33.354093 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 400/786] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:33 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:33.912446 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-f50fa59d-4b32-4490-93e7-d5c4f2b01609 req-e0107ba9-9cd5-49a9-918b-936b0fe225a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a602a74c-fbf6-4ed0-85c6-f1778d879da7", "name": "network-vif-plugged", "status": "completed", "tag": "2a2fc7e3-801b-47fb-9626-bb5520448495"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:45:33.926873 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-f50fa59d-4b32-4490-93e7-d5c4f2b01609 req-e0107ba9-9cd5-49a9-918b-936b0fe225a4 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:33.927598 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-f50fa59d-4b32-4490-93e7-d5c4f2b01609 req-e0107ba9-9cd5-49a9-918b-936b0fe225a4 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:33.942333 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-f50fa59d-4b32-4490-93e7-d5c4f2b01609 req-e0107ba9-9cd5-49a9-918b-936b0fe225a4 service nova] Creating event network-vif-plugged:2a2fc7e3-801b-47fb-9626-bb5520448495 for instance a602a74c-fbf6-4ed0-85c6-f1778d879da7 on hv-cinder-81558 Jun 23 13:45:33.947819 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-f50fa59d-4b32-4490-93e7-d5c4f2b01609 req-e0107ba9-9cd5-49a9-918b-936b0fe225a4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039857 Jun 23 13:45:33.948830 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 387/787] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:45:34.364955 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-f38d6e9f-465f-4691-93f5-328c75d0129c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:34.365501 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-f38d6e9f-465f-4691-93f5-328c75d0129c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:34.374669 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f38d6e9f-465f-4691-93f5-328c75d0129c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:34.375168 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f38d6e9f-465f-4691-93f5-328c75d0129c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:34.375919 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f38d6e9f-465f-4691-93f5-328c75d0129c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:34.376350 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f38d6e9f-465f-4691-93f5-328c75d0129c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:34.522409 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-f38d6e9f-465f-4691-93f5-328c75d0129c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:34.531968 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-f38d6e9f-465f-4691-93f5-328c75d0129c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:34.537968 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-f38d6e9f-465f-4691-93f5-328c75d0129c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:34.540226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-f38d6e9f-465f-4691-93f5-328c75d0129c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1739 microversion: 2.20 time: 0.179503 Jun 23 13:45:34.551119 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 401/788] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:34 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:35.559797 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-214b7a6e-5a33-4175-89f6-4b1e0727001a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:35.560689 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-214b7a6e-5a33-4175-89f6-4b1e0727001a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:35.568832 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-214b7a6e-5a33-4175-89f6-4b1e0727001a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:35.569497 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-214b7a6e-5a33-4175-89f6-4b1e0727001a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:35.570885 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-214b7a6e-5a33-4175-89f6-4b1e0727001a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:35.571449 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-214b7a6e-5a33-4175-89f6-4b1e0727001a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:35.709363 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-214b7a6e-5a33-4175-89f6-4b1e0727001a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:35.717671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-214b7a6e-5a33-4175-89f6-4b1e0727001a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:35.719487 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-214b7a6e-5a33-4175-89f6-4b1e0727001a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:35.720776 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-214b7a6e-5a33-4175-89f6-4b1e0727001a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1739 microversion: 2.20 time: 0.166467 Jun 23 13:45:35.731667 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 388/789] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:35 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:36.739293 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-b9d7de7d-5cef-47dc-b372-7c0113034bd2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:36.740260 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-b9d7de7d-5cef-47dc-b372-7c0113034bd2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:36.742609 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_api:SELECT=50 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:36.748528 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b9d7de7d-5cef-47dc-b372-7c0113034bd2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:36.749212 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b9d7de7d-5cef-47dc-b372-7c0113034bd2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:36.750004 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b9d7de7d-5cef-47dc-b372-7c0113034bd2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:36.750440 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b9d7de7d-5cef-47dc-b372-7c0113034bd2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:36.931966 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-b9d7de7d-5cef-47dc-b372-7c0113034bd2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:36.942612 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-b9d7de7d-5cef-47dc-b372-7c0113034bd2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:36.944845 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-b9d7de7d-5cef-47dc-b372-7c0113034bd2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:36.946091 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-b9d7de7d-5cef-47dc-b372-7c0113034bd2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1739 microversion: 2.20 time: 0.210730 Jun 23 13:45:36.947154 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 402/790] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:36 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:37.965728 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-a98ba1e7-7016-40c9-af6e-daabce0b3cf9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:37.966453 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-a98ba1e7-7016-40c9-af6e-daabce0b3cf9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:37.989085 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a98ba1e7-7016-40c9-af6e-daabce0b3cf9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:37.989764 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a98ba1e7-7016-40c9-af6e-daabce0b3cf9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:37.990751 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a98ba1e7-7016-40c9-af6e-daabce0b3cf9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:37.991276 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a98ba1e7-7016-40c9-af6e-daabce0b3cf9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:38.152453 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-a98ba1e7-7016-40c9-af6e-daabce0b3cf9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:38.161787 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-a98ba1e7-7016-40c9-af6e-daabce0b3cf9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:38.164872 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-a98ba1e7-7016-40c9-af6e-daabce0b3cf9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:38.166049 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-a98ba1e7-7016-40c9-af6e-daabce0b3cf9 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1739 microversion: 2.20 time: 0.204275 Jun 23 13:45:38.177540 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 389/791] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:37 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1739 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:39.184659 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-c02ad6d9-61f4-4471-9bf0-0a1a24ac2c9c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:39.185521 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-c02ad6d9-61f4-4471-9bf0-0a1a24ac2c9c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:39.192592 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c02ad6d9-61f4-4471-9bf0-0a1a24ac2c9c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:39.193021 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c02ad6d9-61f4-4471-9bf0-0a1a24ac2c9c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:39.193875 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c02ad6d9-61f4-4471-9bf0-0a1a24ac2c9c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:39.194468 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c02ad6d9-61f4-4471-9bf0-0a1a24ac2c9c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:39.337228 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-c02ad6d9-61f4-4471-9bf0-0a1a24ac2c9c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:39.346019 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-c02ad6d9-61f4-4471-9bf0-0a1a24ac2c9c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:39.348158 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-c02ad6d9-61f4-4471-9bf0-0a1a24ac2c9c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:39.349474 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-c02ad6d9-61f4-4471-9bf0-0a1a24ac2c9c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1739 microversion: 2.20 time: 0.168859 Jun 23 13:45:39.350346 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 403/792] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:39 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:40.372542 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-f6bf3746-1f3f-40e6-aebf-d556d456df2f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:40.373419 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-f6bf3746-1f3f-40e6-aebf-d556d456df2f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:40.381414 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f6bf3746-1f3f-40e6-aebf-d556d456df2f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:40.381950 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f6bf3746-1f3f-40e6-aebf-d556d456df2f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:40.382845 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f6bf3746-1f3f-40e6-aebf-d556d456df2f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:40.383383 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f6bf3746-1f3f-40e6-aebf-d556d456df2f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:40.406680 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:40.525605 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-f6bf3746-1f3f-40e6-aebf-d556d456df2f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:40.534044 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-f6bf3746-1f3f-40e6-aebf-d556d456df2f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:40.535580 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-f6bf3746-1f3f-40e6-aebf-d556d456df2f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:40.536745 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-f6bf3746-1f3f-40e6-aebf-d556d456df2f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1739 microversion: 2.20 time: 0.170933 Jun 23 13:45:40.537311 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 390/793] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:40 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:41.558233 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-198b1560-020b-4605-903b-25ee147eef97 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:41.559228 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-198b1560-020b-4605-903b-25ee147eef97 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:41.570809 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-198b1560-020b-4605-903b-25ee147eef97 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:41.571649 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-198b1560-020b-4605-903b-25ee147eef97 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:41.572912 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-198b1560-020b-4605-903b-25ee147eef97 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:41.573629 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-198b1560-020b-4605-903b-25ee147eef97 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:41.718038 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-198b1560-020b-4605-903b-25ee147eef97 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:41.726054 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-198b1560-020b-4605-903b-25ee147eef97 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:41.727602 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-198b1560-020b-4605-903b-25ee147eef97 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:41.728763 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-198b1560-020b-4605-903b-25ee147eef97 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1739 microversion: 2.20 time: 0.177314 Jun 23 13:45:41.729321 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 404/794] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:41 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:42.747741 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-a5e14083-9388-4a16-9cf3-86ba827bf351 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:42.748356 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-a5e14083-9388-4a16-9cf3-86ba827bf351 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:42.755150 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a5e14083-9388-4a16-9cf3-86ba827bf351 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:42.755698 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a5e14083-9388-4a16-9cf3-86ba827bf351 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:42.756462 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a5e14083-9388-4a16-9cf3-86ba827bf351 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:42.756897 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a5e14083-9388-4a16-9cf3-86ba827bf351 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:42.893310 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-a5e14083-9388-4a16-9cf3-86ba827bf351 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:42.901366 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-a5e14083-9388-4a16-9cf3-86ba827bf351 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:42.902874 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-a5e14083-9388-4a16-9cf3-86ba827bf351 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:42.904087 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-a5e14083-9388-4a16-9cf3-86ba827bf351 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1739 microversion: 2.20 time: 0.160361 Jun 23 13:45:42.904671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 391/795] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:42 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:43.926272 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-5f69df71-773c-4fe4-88d1-56d8124a1b23 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:43.927276 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-5f69df71-773c-4fe4-88d1-56d8124a1b23 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:43.936727 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5f69df71-773c-4fe4-88d1-56d8124a1b23 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:43.937178 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5f69df71-773c-4fe4-88d1-56d8124a1b23 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:43.937926 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5f69df71-773c-4fe4-88d1-56d8124a1b23 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:43.938355 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5f69df71-773c-4fe4-88d1-56d8124a1b23 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:44.072723 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-5f69df71-773c-4fe4-88d1-56d8124a1b23 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:44.080957 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-5f69df71-773c-4fe4-88d1-56d8124a1b23 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:44.082785 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-5f69df71-773c-4fe4-88d1-56d8124a1b23 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:44.083997 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-5f69df71-773c-4fe4-88d1-56d8124a1b23 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1721 microversion: 2.20 time: 0.164612 Jun 23 13:45:44.084543 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 405/796] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:43 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:45.106263 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-87180d2c-1d49-4a6c-a848-0db29003b524 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:45.107801 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-87180d2c-1d49-4a6c-a848-0db29003b524 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:45.110822 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:45.118902 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-87180d2c-1d49-4a6c-a848-0db29003b524 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:45.119439 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-87180d2c-1d49-4a6c-a848-0db29003b524 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:45.120218 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-87180d2c-1d49-4a6c-a848-0db29003b524 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:45.120655 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-87180d2c-1d49-4a6c-a848-0db29003b524 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:45.254685 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-87180d2c-1d49-4a6c-a848-0db29003b524 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:45.262774 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-87180d2c-1d49-4a6c-a848-0db29003b524 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:45.264387 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-87180d2c-1d49-4a6c-a848-0db29003b524 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:45.265538 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-87180d2c-1d49-4a6c-a848-0db29003b524 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1721 microversion: 2.20 time: 0.166154 Jun 23 13:45:45.266092 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 392/797] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:45 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:46.287972 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-28e5ac39-95e2-4afd-8d59-1f4eff7955c7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:46.288968 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-28e5ac39-95e2-4afd-8d59-1f4eff7955c7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:46.299984 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-28e5ac39-95e2-4afd-8d59-1f4eff7955c7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:46.300736 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-28e5ac39-95e2-4afd-8d59-1f4eff7955c7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:46.301973 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-28e5ac39-95e2-4afd-8d59-1f4eff7955c7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:46.302656 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-28e5ac39-95e2-4afd-8d59-1f4eff7955c7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:46.439709 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-28e5ac39-95e2-4afd-8d59-1f4eff7955c7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:46.441541 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=100 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:46.448920 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-28e5ac39-95e2-4afd-8d59-1f4eff7955c7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:46.450439 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-28e5ac39-95e2-4afd-8d59-1f4eff7955c7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:46.451623 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-28e5ac39-95e2-4afd-8d59-1f4eff7955c7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1664 microversion: 2.20 time: 0.170314 Jun 23 13:45:46.452214 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 406/798] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:46 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1664 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:46.470220 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-3988035f-58ff-4d32-8736-bdb43b92f698 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e37e62f-c1fc-4272-991a-5f33cc5683b9"}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:45:46.472455 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-3988035f-58ff-4d32-8736-bdb43b92f698 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:46.479089 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3988035f-58ff-4d32-8736-bdb43b92f698 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:46.479953 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3988035f-58ff-4d32-8736-bdb43b92f698 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:46.480732 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3988035f-58ff-4d32-8736-bdb43b92f698 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:46.481173 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3988035f-58ff-4d32-8736-bdb43b92f698 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:46.760515 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-3988035f-58ff-4d32-8736-bdb43b92f698 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "POST /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.294468 Jun 23 13:45:46.761135 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 393/799] 10.222.0.26 () {62 vars in 1363 bytes} [Thu Jun 23 13:45:46 2022] POST /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7/os-volume_attachments => generated 188 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 13:45:46.874997 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-52d2c2d5-0425-4d39-a88b-a0ae05252a61 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:46.875749 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-52d2c2d5-0425-4d39-a88b-a0ae05252a61 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:46.882167 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-52d2c2d5-0425-4d39-a88b-a0ae05252a61 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:46.882629 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-52d2c2d5-0425-4d39-a88b-a0ae05252a61 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:46.883436 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-52d2c2d5-0425-4d39-a88b-a0ae05252a61 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:46.884121 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-52d2c2d5-0425-4d39-a88b-a0ae05252a61 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:47.271751 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-34e2c90e-9bb6-43fc-88d1-6ccf425010e5 req-972b4b7b-44ab-46e3-8b47-1d6dd918aa2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a602a74c-fbf6-4ed0-85c6-f1778d879da7", "name": "network-vif-unplugged", "status": "completed", "tag": "2a2fc7e3-801b-47fb-9626-bb5520448495"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:45:47.281842 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-34e2c90e-9bb6-43fc-88d1-6ccf425010e5 req-972b4b7b-44ab-46e3-8b47-1d6dd918aa2b service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:47.282808 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-34e2c90e-9bb6-43fc-88d1-6ccf425010e5 req-972b4b7b-44ab-46e3-8b47-1d6dd918aa2b service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:47.295534 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.compute.server_external_events [req-34e2c90e-9bb6-43fc-88d1-6ccf425010e5 req-972b4b7b-44ab-46e3-8b47-1d6dd918aa2b service nova] Unable to find a host for instance a602a74c-fbf6-4ed0-85c6-f1778d879da7. Dropping event network-vif-unplugged {{(pid=134666) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 23 13:45:47.297420 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-34e2c90e-9bb6-43fc-88d1-6ccf425010e5 req-972b4b7b-44ab-46e3-8b47-1d6dd918aa2b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029543 Jun 23 13:45:47.298557 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 394/800] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 23 13:45:47.305195 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-52d2c2d5-0425-4d39-a88b-a0ae05252a61 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7/os-volume_attachments/9e37e62f-c1fc-4272-991a-5f33cc5683b9" status: 202 len: 0 microversion: 2.20 time: 0.434511 Jun 23 13:45:47.306389 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 407/801] 10.222.0.26 () {60 vars in 1456 bytes} [Thu Jun 23 13:45:46 2022] DELETE /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7/os-volume_attachments/9e37e62f-c1fc-4272-991a-5f33cc5683b9 => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 13:45:47.366296 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-df82444e-a673-4afd-a2e8-d10005c5e694 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:45:47.366997 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-df82444e-a673-4afd-a2e8-d10005c5e694 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:47.375065 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-df82444e-a673-4afd-a2e8-d10005c5e694 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:47.375727 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-df82444e-a673-4afd-a2e8-d10005c5e694 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:47.376665 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-df82444e-a673-4afd-a2e8-d10005c5e694 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:47.377107 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-df82444e-a673-4afd-a2e8-d10005c5e694 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:47.458430 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-df82444e-a673-4afd-a2e8-d10005c5e694 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "POST /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7/action" status: 202 len: 0 microversion: 2.20 time: 0.096062 Jun 23 13:45:47.459049 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 395/802] 10.222.0.26 () {62 vars in 1318 bytes} [Thu Jun 23 13:45:47 2022] POST /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 13:45:47.467174 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-eafc2c18-453f-4e99-86e0-729ab59a9942 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:47.467819 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-eafc2c18-453f-4e99-86e0-729ab59a9942 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:47.474333 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-eafc2c18-453f-4e99-86e0-729ab59a9942 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:47.474905 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-eafc2c18-453f-4e99-86e0-729ab59a9942 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:47.475809 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-eafc2c18-453f-4e99-86e0-729ab59a9942 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:47.476343 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-eafc2c18-453f-4e99-86e0-729ab59a9942 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:47.643847 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-eafc2c18-453f-4e99-86e0-729ab59a9942 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:47.655789 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-eafc2c18-453f-4e99-86e0-729ab59a9942 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:47.655789 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-eafc2c18-453f-4e99-86e0-729ab59a9942 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:47.660153 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-eafc2c18-453f-4e99-86e0-729ab59a9942 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1672 microversion: 2.20 time: 0.196855 Jun 23 13:45:47.660980 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 408/803] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:47 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1672 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:48.678837 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-17f1dd12-6947-4d38-9b8e-66d9d242a17a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:48.679448 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-17f1dd12-6947-4d38-9b8e-66d9d242a17a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:48.685749 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-17f1dd12-6947-4d38-9b8e-66d9d242a17a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:48.686194 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-17f1dd12-6947-4d38-9b8e-66d9d242a17a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:48.686990 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-17f1dd12-6947-4d38-9b8e-66d9d242a17a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:48.687472 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-17f1dd12-6947-4d38-9b8e-66d9d242a17a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:48.828362 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-17f1dd12-6947-4d38-9b8e-66d9d242a17a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:48.836928 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-17f1dd12-6947-4d38-9b8e-66d9d242a17a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:48.838516 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-17f1dd12-6947-4d38-9b8e-66d9d242a17a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:48.839790 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-17f1dd12-6947-4d38-9b8e-66d9d242a17a tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1730 microversion: 2.20 time: 0.165488 Jun 23 13:45:48.840372 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 396/804] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:48 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:49.859963 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-292f35cf-7514-4203-9242-6f5aa3f26c01 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:49.860638 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-292f35cf-7514-4203-9242-6f5aa3f26c01 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:49.873372 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-292f35cf-7514-4203-9242-6f5aa3f26c01 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:49.874653 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-292f35cf-7514-4203-9242-6f5aa3f26c01 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:49.875699 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-292f35cf-7514-4203-9242-6f5aa3f26c01 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:49.876212 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-292f35cf-7514-4203-9242-6f5aa3f26c01 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:50.119120 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-292f35cf-7514-4203-9242-6f5aa3f26c01 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:50.130231 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-292f35cf-7514-4203-9242-6f5aa3f26c01 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:50.132189 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-292f35cf-7514-4203-9242-6f5aa3f26c01 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:50.133745 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-292f35cf-7514-4203-9242-6f5aa3f26c01 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1730 microversion: 2.20 time: 0.279097 Jun 23 13:45:50.144509 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 409/805] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:49 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1730 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:51.153721 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-817d0031-fd6e-4a5d-9b3e-fb15ac9f0dd7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:51.154384 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-817d0031-fd6e-4a5d-9b3e-fb15ac9f0dd7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:51.161911 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-817d0031-fd6e-4a5d-9b3e-fb15ac9f0dd7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:51.162560 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-817d0031-fd6e-4a5d-9b3e-fb15ac9f0dd7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:51.163548 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-817d0031-fd6e-4a5d-9b3e-fb15ac9f0dd7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:51.164131 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-817d0031-fd6e-4a5d-9b3e-fb15ac9f0dd7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:51.322859 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-817d0031-fd6e-4a5d-9b3e-fb15ac9f0dd7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:51.336043 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-817d0031-fd6e-4a5d-9b3e-fb15ac9f0dd7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:51.345094 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-817d0031-fd6e-4a5d-9b3e-fb15ac9f0dd7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:51.346684 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-817d0031-fd6e-4a5d-9b3e-fb15ac9f0dd7 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1730 microversion: 2.20 time: 0.197164 Jun 23 13:45:51.347565 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 397/806] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:51 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1730 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:52.174566 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-262ed019-4a9b-47e7-9806-bdda82c41cb0 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:52.175182 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-262ed019-4a9b-47e7-9806-bdda82c41cb0 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:52.184813 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-262ed019-4a9b-47e7-9806-bdda82c41cb0 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:52.185412 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-262ed019-4a9b-47e7-9806-bdda82c41cb0 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:52.186195 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-262ed019-4a9b-47e7-9806-bdda82c41cb0 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:52.186637 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-262ed019-4a9b-47e7-9806-bdda82c41cb0 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:52.211638 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-262ed019-4a9b-47e7-9806-bdda82c41cb0 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Going to try to terminate instance {{(pid=134667) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 13:45:52.293517 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-262ed019-4a9b-47e7-9806-bdda82c41cb0 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "DELETE /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 204 len: 0 microversion: 2.1 time: 0.122499 Jun 23 13:45:52.294165 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 410/807] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Jun 23 13:45:52 2022] DELETE /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 13:45:52.302921 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-84705246-da58-488c-b6d3-fab96048d88e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:52.304163 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-84705246-da58-488c-b6d3-fab96048d88e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:52.311254 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-84705246-da58-488c-b6d3-fab96048d88e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:52.311902 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-84705246-da58-488c-b6d3-fab96048d88e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:52.312766 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-84705246-da58-488c-b6d3-fab96048d88e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:52.313335 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-84705246-da58-488c-b6d3-fab96048d88e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:52.366558 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-26946ae0-0b67-4252-a372-96c2e20cc61e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:52.367316 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-26946ae0-0b67-4252-a372-96c2e20cc61e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:52.373555 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-26946ae0-0b67-4252-a372-96c2e20cc61e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:52.373995 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-26946ae0-0b67-4252-a372-96c2e20cc61e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:52.374788 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-26946ae0-0b67-4252-a372-96c2e20cc61e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:52.375215 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-26946ae0-0b67-4252-a372-96c2e20cc61e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:52.538814 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-84705246-da58-488c-b6d3-fab96048d88e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:52.545806 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-84705246-da58-488c-b6d3-fab96048d88e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 200 len: 1575 microversion: 2.1 time: 0.246692 Jun 23 13:45:52.547216 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 398/808] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:45:52 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 1575 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:45:52.575575 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-26946ae0-0b67-4252-a372-96c2e20cc61e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:52.585487 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-26946ae0-0b67-4252-a372-96c2e20cc61e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:52.586995 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-26946ae0-0b67-4252-a372-96c2e20cc61e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:52.588321 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-26946ae0-0b67-4252-a372-96c2e20cc61e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1730 microversion: 2.20 time: 0.226072 Jun 23 13:45:52.589317 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 411/809] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:52 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1730 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 13:45:53.569627 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-e684ce99-1e97-4727-89ed-c2d854fdd764 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:53.569627 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-e684ce99-1e97-4727-89ed-c2d854fdd764 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:53.574631 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e684ce99-1e97-4727-89ed-c2d854fdd764 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:53.575295 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e684ce99-1e97-4727-89ed-c2d854fdd764 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:53.576403 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e684ce99-1e97-4727-89ed-c2d854fdd764 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:53.577015 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e684ce99-1e97-4727-89ed-c2d854fdd764 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:53.612355 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-211a4637-438d-4a15-9d7c-abab12f87a8e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:53.613576 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-211a4637-438d-4a15-9d7c-abab12f87a8e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:53.620651 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-211a4637-438d-4a15-9d7c-abab12f87a8e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:53.628289 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-211a4637-438d-4a15-9d7c-abab12f87a8e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:53.629345 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-211a4637-438d-4a15-9d7c-abab12f87a8e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:53.629937 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-211a4637-438d-4a15-9d7c-abab12f87a8e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:53.832188 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-e684ce99-1e97-4727-89ed-c2d854fdd764 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:53.843217 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-e684ce99-1e97-4727-89ed-c2d854fdd764 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 200 len: 1575 microversion: 2.1 time: 0.283121 Jun 23 13:45:53.857172 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 399/810] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:45:53 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 1575 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:45:53.866347 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-211a4637-438d-4a15-9d7c-abab12f87a8e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:53.877691 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-211a4637-438d-4a15-9d7c-abab12f87a8e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:53.879326 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-211a4637-438d-4a15-9d7c-abab12f87a8e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:53.880543 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-211a4637-438d-4a15-9d7c-abab12f87a8e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1730 microversion: 2.20 time: 0.272102 Jun 23 13:45:53.881173 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 412/811] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:53 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1730 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:54.864134 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-e895977d-dffe-4a55-8d3e-912eccb43e62 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:54.864977 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-e895977d-dffe-4a55-8d3e-912eccb43e62 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:54.872982 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e895977d-dffe-4a55-8d3e-912eccb43e62 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:54.873563 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e895977d-dffe-4a55-8d3e-912eccb43e62 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:54.876496 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e895977d-dffe-4a55-8d3e-912eccb43e62 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:54.877269 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e895977d-dffe-4a55-8d3e-912eccb43e62 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:54.898018 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-a39b4e67-6727-4b92-aecb-ce0b5b196208 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:54.899894 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-a39b4e67-6727-4b92-aecb-ce0b5b196208 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:54.905689 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a39b4e67-6727-4b92-aecb-ce0b5b196208 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:54.906364 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a39b4e67-6727-4b92-aecb-ce0b5b196208 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:54.907369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a39b4e67-6727-4b92-aecb-ce0b5b196208 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:54.907966 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a39b4e67-6727-4b92-aecb-ce0b5b196208 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:55.139725 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-a39b4e67-6727-4b92-aecb-ce0b5b196208 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:55.148968 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-a39b4e67-6727-4b92-aecb-ce0b5b196208 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:55.151115 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-a39b4e67-6727-4b92-aecb-ce0b5b196208 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:55.152549 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-a39b4e67-6727-4b92-aecb-ce0b5b196208 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1730 microversion: 2.20 time: 0.258522 Jun 23 13:45:55.153681 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 413/812] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:54 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1730 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:55.176099 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-e895977d-dffe-4a55-8d3e-912eccb43e62 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:55.185830 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-e895977d-dffe-4a55-8d3e-912eccb43e62 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 200 len: 1575 microversion: 2.1 time: 0.324881 Jun 23 13:45:55.186580 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 400/813] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:45:54 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 1575 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:45:55.864481 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-7a7c368c-a846-4b99-8182-2970dfeb1cee tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:55.865253 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-7a7c368c-a846-4b99-8182-2970dfeb1cee tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 7840b5d2-52e9-48db-95ba-af0fb4a5cb52] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:55.874707 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7a7c368c-a846-4b99-8182-2970dfeb1cee tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:55.875453 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7a7c368c-a846-4b99-8182-2970dfeb1cee tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:55.876411 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7a7c368c-a846-4b99-8182-2970dfeb1cee tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:55.876997 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7a7c368c-a846-4b99-8182-2970dfeb1cee tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:55.901508 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-7a7c368c-a846-4b99-8182-2970dfeb1cee tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52/ips" status: 200 len: 150 microversion: 2.1 time: 0.043863 Jun 23 13:45:55.902431 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 414/814] 10.222.0.26 () {58 vars in 1247 bytes} [Thu Jun 23 13:45:55 2022] GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:45:56.172126 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-47190830-adc3-4a02-a2d4-35375c5c90d2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:56.173065 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-47190830-adc3-4a02-a2d4-35375c5c90d2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:56.182278 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-47190830-adc3-4a02-a2d4-35375c5c90d2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:56.183058 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-47190830-adc3-4a02-a2d4-35375c5c90d2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:56.184161 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-47190830-adc3-4a02-a2d4-35375c5c90d2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:56.185568 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-47190830-adc3-4a02-a2d4-35375c5c90d2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:56.204085 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-f48353a0-a824-4a82-9ec8-c3656bdf9055 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:56.205176 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-f48353a0-a824-4a82-9ec8-c3656bdf9055 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:56.227549 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f48353a0-a824-4a82-9ec8-c3656bdf9055 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:56.228513 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f48353a0-a824-4a82-9ec8-c3656bdf9055 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:56.229485 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f48353a0-a824-4a82-9ec8-c3656bdf9055 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:56.230212 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f48353a0-a824-4a82-9ec8-c3656bdf9055 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:56.432384 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-47190830-adc3-4a02-a2d4-35375c5c90d2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:56.440847 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-47190830-adc3-4a02-a2d4-35375c5c90d2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:56.442422 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-47190830-adc3-4a02-a2d4-35375c5c90d2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:56.446303 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-47190830-adc3-4a02-a2d4-35375c5c90d2 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1730 microversion: 2.20 time: 0.276828 Jun 23 13:45:56.462558 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 401/815] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:56 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1730 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:56.491059 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-f48353a0-a824-4a82-9ec8-c3656bdf9055 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:56.499452 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-f48353a0-a824-4a82-9ec8-c3656bdf9055 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 200 len: 1575 microversion: 2.1 time: 0.300096 Jun 23 13:45:56.500274 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 415/816] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:45:56 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 1575 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:45:57.368506 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-16917332-70fb-4549-944a-6c1372d1bc35 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5bfa73b8-b311-4add-9d78-b3b417eb7448"}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:45:57.370297 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-16917332-70fb-4549-944a-6c1372d1bc35 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 7840b5d2-52e9-48db-95ba-af0fb4a5cb52] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:57.378555 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-16917332-70fb-4549-944a-6c1372d1bc35 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:57.379433 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-16917332-70fb-4549-944a-6c1372d1bc35 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:57.380407 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-16917332-70fb-4549-944a-6c1372d1bc35 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:57.381027 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-16917332-70fb-4549-944a-6c1372d1bc35 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:57.471120 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-ff3f699a-f353-4353-9ea2-e99824991f17 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:57.471882 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-ff3f699a-f353-4353-9ea2-e99824991f17 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:57.484362 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ff3f699a-f353-4353-9ea2-e99824991f17 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:57.484817 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ff3f699a-f353-4353-9ea2-e99824991f17 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:57.486701 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ff3f699a-f353-4353-9ea2-e99824991f17 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:57.487872 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ff3f699a-f353-4353-9ea2-e99824991f17 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:57.630044 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-ff3f699a-f353-4353-9ea2-e99824991f17 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:57.638689 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-ff3f699a-f353-4353-9ea2-e99824991f17 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:57.640287 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-ff3f699a-f353-4353-9ea2-e99824991f17 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:57.641591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-ff3f699a-f353-4353-9ea2-e99824991f17 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1730 microversion: 2.20 time: 0.180389 Jun 23 13:45:57.642140 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 416/817] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:57 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:45:57.646570 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-c14ff793-4517-4a4d-886c-b51e6aa08b5d tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:57.647174 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-c14ff793-4517-4a4d-886c-b51e6aa08b5d tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:57.653121 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c14ff793-4517-4a4d-886c-b51e6aa08b5d tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:57.653583 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c14ff793-4517-4a4d-886c-b51e6aa08b5d tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:57.654346 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c14ff793-4517-4a4d-886c-b51e6aa08b5d tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:57.654785 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c14ff793-4517-4a4d-886c-b51e6aa08b5d tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:57.797229 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-c14ff793-4517-4a4d-886c-b51e6aa08b5d tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:57.809136 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-c14ff793-4517-4a4d-886c-b51e6aa08b5d tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 200 len: 1575 microversion: 2.1 time: 0.165983 Jun 23 13:45:57.809720 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 417/818] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:45:57 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:45:58.660429 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-2e008165-99ad-47ee-a65c-ef3d58f6e04c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:58.661169 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-2e008165-99ad-47ee-a65c-ef3d58f6e04c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:58.668500 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2e008165-99ad-47ee-a65c-ef3d58f6e04c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:58.668953 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2e008165-99ad-47ee-a65c-ef3d58f6e04c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:58.669741 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2e008165-99ad-47ee-a65c-ef3d58f6e04c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:58.670173 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2e008165-99ad-47ee-a65c-ef3d58f6e04c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:58.813577 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-2e008165-99ad-47ee-a65c-ef3d58f6e04c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:58.821394 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-2e008165-99ad-47ee-a65c-ef3d58f6e04c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:58.822874 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-2e008165-99ad-47ee-a65c-ef3d58f6e04c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:58.824068 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-2e008165-99ad-47ee-a65c-ef3d58f6e04c tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1730 microversion: 2.20 time: 0.168082 Jun 23 13:45:58.824620 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 418/819] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:58 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 13:45:58.828977 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-dd56e2d9-d2f0-404b-9fa9-dc3c168db17e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:58.829561 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-dd56e2d9-d2f0-404b-9fa9-dc3c168db17e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:58.835801 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-dd56e2d9-d2f0-404b-9fa9-dc3c168db17e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:58.836247 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-dd56e2d9-d2f0-404b-9fa9-dc3c168db17e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:58.837007 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-dd56e2d9-d2f0-404b-9fa9-dc3c168db17e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:58.837439 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-dd56e2d9-d2f0-404b-9fa9-dc3c168db17e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:58.857785 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:45:58.973827 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-dd56e2d9-d2f0-404b-9fa9-dc3c168db17e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:45:58.981534 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-dd56e2d9-d2f0-404b-9fa9-dc3c168db17e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 200 len: 1575 microversion: 2.1 time: 0.155957 Jun 23 13:45:58.982367 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 419/820] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:45:58 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:45:59.842199 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-995a1ae2-eb36-451f-b280-1f9f37045b5d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:45:59.842950 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-995a1ae2-eb36-451f-b280-1f9f37045b5d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:45:59.849717 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-995a1ae2-eb36-451f-b280-1f9f37045b5d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:59.850165 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-995a1ae2-eb36-451f-b280-1f9f37045b5d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:59.851064 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-995a1ae2-eb36-451f-b280-1f9f37045b5d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:45:59.851530 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-995a1ae2-eb36-451f-b280-1f9f37045b5d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:45:59.991891 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-995a1ae2-eb36-451f-b280-1f9f37045b5d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:00.001314 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-995a1ae2-eb36-451f-b280-1f9f37045b5d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:00.002729 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-995a1ae2-eb36-451f-b280-1f9f37045b5d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:00.003939 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-995a1ae2-eb36-451f-b280-1f9f37045b5d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1730 microversion: 2.20 time: 0.165801 Jun 23 13:46:00.004492 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 420/821] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:45:59 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:46:00.009107 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-d1f7d547-843b-4ea1-a490-7fad7a96b919 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:00.009909 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-d1f7d547-843b-4ea1-a490-7fad7a96b919 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:00.016116 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d1f7d547-843b-4ea1-a490-7fad7a96b919 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:00.016577 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d1f7d547-843b-4ea1-a490-7fad7a96b919 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:00.017355 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d1f7d547-843b-4ea1-a490-7fad7a96b919 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:00.017796 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d1f7d547-843b-4ea1-a490-7fad7a96b919 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:00.123729 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:00.135712 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-16917332-70fb-4549-944a-6c1372d1bc35 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "POST /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.771743 Jun 23 13:46:00.136352 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 402/822] 10.222.0.26 () {60 vars in 1322 bytes} [Thu Jun 23 13:45:57 2022] POST /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52/os-volume_attachments => generated 194 bytes in 2773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:46:00.162692 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-d1f7d547-843b-4ea1-a490-7fad7a96b919 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:00.170496 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-d1f7d547-843b-4ea1-a490-7fad7a96b919 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 200 len: 1575 microversion: 2.1 time: 0.164771 Jun 23 13:46:00.171065 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 421/823] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:00 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:01.023691 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-48b6a44a-5824-412a-ba17-ebc0e8d498f8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:01.024284 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-48b6a44a-5824-412a-ba17-ebc0e8d498f8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:01.031782 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-48b6a44a-5824-412a-ba17-ebc0e8d498f8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:01.032226 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-48b6a44a-5824-412a-ba17-ebc0e8d498f8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:01.033016 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-48b6a44a-5824-412a-ba17-ebc0e8d498f8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:01.033451 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-48b6a44a-5824-412a-ba17-ebc0e8d498f8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:01.173288 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-48b6a44a-5824-412a-ba17-ebc0e8d498f8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:01.181755 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-48b6a44a-5824-412a-ba17-ebc0e8d498f8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:01.188055 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-4ba60a00-24e0-4ca8-b825-d3f99aeabf2b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:01.188666 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-4ba60a00-24e0-4ca8-b825-d3f99aeabf2b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:01.189866 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-48b6a44a-5824-412a-ba17-ebc0e8d498f8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:01.191213 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-48b6a44a-5824-412a-ba17-ebc0e8d498f8 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1730 microversion: 2.20 time: 0.172724 Jun 23 13:46:01.195314 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 403/824] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:46:01 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:46:01.201434 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4ba60a00-24e0-4ca8-b825-d3f99aeabf2b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:01.201987 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4ba60a00-24e0-4ca8-b825-d3f99aeabf2b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:01.203035 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4ba60a00-24e0-4ca8-b825-d3f99aeabf2b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:01.205149 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4ba60a00-24e0-4ca8-b825-d3f99aeabf2b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:01.298918 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-4ba60a00-24e0-4ca8-b825-d3f99aeabf2b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:01.307701 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-4ba60a00-24e0-4ca8-b825-d3f99aeabf2b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 200 len: 1510 microversion: 2.1 time: 0.123242 Jun 23 13:46:01.315528 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 422/825] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:01 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 1510 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:01.394461 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-39169950-ea41-4a7b-bee4-1f407ce42d4f req-38a6b946-41f4-4ed5-b76e-ef0ba35fec1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42c29e33-917a-4263-a80c-9863ed228875", "name": "network-vif-deleted", "tag": "e81f7986-69e2-48bc-88f6-03a52eb426dd"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:46:01.406498 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-39169950-ea41-4a7b-bee4-1f407ce42d4f req-38a6b946-41f4-4ed5-b76e-ef0ba35fec1c service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:01.406947 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-39169950-ea41-4a7b-bee4-1f407ce42d4f req-38a6b946-41f4-4ed5-b76e-ef0ba35fec1c service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:01.421967 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-39169950-ea41-4a7b-bee4-1f407ce42d4f req-38a6b946-41f4-4ed5-b76e-ef0ba35fec1c service nova] Creating event network-vif-deleted:e81f7986-69e2-48bc-88f6-03a52eb426dd for instance 42c29e33-917a-4263-a80c-9863ed228875 on hv-cinder-81558 Jun 23 13:46:01.426618 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-273b370b-229a-4c4f-a95e-129c587cf009 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1576418060", "imageRef": "dd7aacbf-3b3e-496e-967e-53d2a1b1f200", "flavorRef": "452"}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:46:01.427359 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-39169950-ea41-4a7b-bee4-1f407ce42d4f req-38a6b946-41f4-4ed5-b76e-ef0ba35fec1c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036453 Jun 23 13:46:01.428270 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 404/826] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:46:01.481934 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.network.neutron [None req-273b370b-229a-4c4f-a95e-129c587cf009 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] validate_networks() for None {{(pid=134667) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 13:46:01.760835 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-273b370b-229a-4c4f-a95e-129c587cf009 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Flavor limits 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 13:46:01.761851 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-273b370b-229a-4c4f-a95e-129c587cf009 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Image limits 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 13:46:01.762341 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-273b370b-229a-4c4f-a95e-129c587cf009 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Flavor pref 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 13:46:01.762736 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-273b370b-229a-4c4f-a95e-129c587cf009 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Image pref 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 13:46:01.763448 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-273b370b-229a-4c4f-a95e-129c587cf009 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 13:46:01.773006 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-273b370b-229a-4c4f-a95e-129c587cf009 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:01.773459 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-273b370b-229a-4c4f-a95e-129c587cf009 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:01.774224 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-273b370b-229a-4c4f-a95e-129c587cf009 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:01.774659 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-273b370b-229a-4c4f-a95e-129c587cf009 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:01.791603 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.quota [None req-273b370b-229a-4c4f-a95e-129c587cf009 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Getting quotas for project 2bc4a7159fa34affae55ebdbb866f88b. Resources: {'ram', 'cores', 'instances'} {{(pid=134667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:46:01.796103 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.quota [None req-273b370b-229a-4c4f-a95e-129c587cf009 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Getting quotas for user 7cd2882baad040019be3aa1e554c5905 and project 2bc4a7159fa34affae55ebdbb866f88b. Resources: {'ram', 'cores', 'instances'} {{(pid=134667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:46:01.813213 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-273b370b-229a-4c4f-a95e-129c587cf009 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Going to run 1 instances... {{(pid=134667) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 13:46:01.816527 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-273b370b-229a-4c4f-a95e-129c587cf009 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] [instance: 75191b56-043b-4024-81a1-d0b1b33391ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7aacbf-3b3e-496e-967e-53d2a1b1f200',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134667) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 13:46:01.866624 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-273b370b-229a-4c4f-a95e-129c587cf009 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.443768 Jun 23 13:46:01.867870 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 423/827] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Jun 23 13:46:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 13:46:01.879517 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-efa2b0c7-bc12-42f1-9ba1-bf1750fc1aae tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:01.880495 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-efa2b0c7-bc12-42f1-9ba1-bf1750fc1aae tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] [instance: 75191b56-043b-4024-81a1-d0b1b33391ee] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:01.937344 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-efa2b0c7-bc12-42f1-9ba1-bf1750fc1aae tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd2882baad040019be3aa1e554c5905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc4a7159fa34affae55ebdbb866f88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:01.945230 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-efa2b0c7-bc12-42f1-9ba1-bf1750fc1aae tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] 10.222.0.26 "GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee" status: 200 len: 1215 microversion: 2.1 time: 0.070887 Jun 23 13:46:01.946067 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 405/828] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:01 2022] GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:02.210840 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-e81928e4-c8c2-49a2-927c-1c6265d1d582 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:02.211853 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-e81928e4-c8c2-49a2-927c-1c6265d1d582 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:02.218672 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e81928e4-c8c2-49a2-927c-1c6265d1d582 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:02.219198 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e81928e4-c8c2-49a2-927c-1c6265d1d582 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:02.220170 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e81928e4-c8c2-49a2-927c-1c6265d1d582 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:02.220744 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e81928e4-c8c2-49a2-927c-1c6265d1d582 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:02.325398 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-ccb97965-faeb-4e40-a1ce-05902a22c903 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:02.326182 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-ccb97965-faeb-4e40-a1ce-05902a22c903 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:02.335162 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ccb97965-faeb-4e40-a1ce-05902a22c903 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:02.342149 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ccb97965-faeb-4e40-a1ce-05902a22c903 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:02.345168 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ccb97965-faeb-4e40-a1ce-05902a22c903 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:02.346084 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ccb97965-faeb-4e40-a1ce-05902a22c903 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:02.364690 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.wsgi [None req-ccb97965-faeb-4e40-a1ce-05902a22c903 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] HTTP exception thrown: Instance 42c29e33-917a-4263-a80c-9863ed228875 could not be found. Jun 23 13:46:02.366889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-ccb97965-faeb-4e40-a1ce-05902a22c903 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Request method failure captured: Jun 23 13:46:02.366889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: request: GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 HTTP/1.1 Jun 23 13:46:02.366889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept: application/json Jun 23 13:46:02.366889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept-Encoding: identity Jun 23 13:46:02.366889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Connection: close Jun 23 13:46:02.366889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Length: 0 Jun 23 13:46:02.366889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Type: application/json Jun 23 13:46:02.366889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Host: 10.222.0.26 Jun 23 13:46:02.366889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Openstack-System-Scope: None Jun 23 13:46:02.366889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: User-Agent: python-urllib3/1.26.9 Jun 23 13:46:02.366889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Auth-Token: gAAAAABitG3LhHYxLw9V8q4SHO5dUJ0ZlE_I44zxSKkMSakbtRg_B1BDGNLxXvzE-VVy80jLCkdRC3l06S7zhBm8Oi4OkjoNGXcaRhMM6oj17IETDNl-rIvjYdOkoPRXCne87ZFxWkidUCT-AeZPw7Y2snKNRNW3KwjmToqlI8x2fMezG0FhYbg Jun 23 13:46:02.366889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Id: None Jun 23 13:46:02.366889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Name: None Jun 23 13:46:02.366889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Identity-Status: Confirmed Jun 23 13:46:02.366889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Is-Admin-Project: True Jun 23 13:46:02.366889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Id: default Jun 23 13:46:02.366889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Name: Default Jun 23 13:46:02.366889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Id: 0d6c438e59834c4084c818053e1fdb93 Jun 23 13:46:02.366889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Name: tempest-TestVolumeBootPattern-1088681018 Jun 23 13:46:02.366889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Role: member,reader Jun 23 13:46:02.366889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Roles: member,reader Jun 23 13:46:02.368515 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0d6c438e59834c4084c818053e1fdb93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0d6c438e59834c4084c818053e1fdb93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0d6c438e59834c4084c818053e1fdb93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0d6c438e59834c4084c818053e1fdb93", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:46:02.368515 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant: tempest-TestVolumeBootPattern-1088681018 Jun 23 13:46:02.368515 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Id: 0d6c438e59834c4084c818053e1fdb93 Jun 23 13:46:02.368515 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Name: tempest-TestVolumeBootPattern-1088681018 Jun 23 13:46:02.368515 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User: tempest-TestVolumeBootPattern-1088681018-project Jun 23 13:46:02.368515 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Id: default Jun 23 13:46:02.368515 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Name: Default Jun 23 13:46:02.368515 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Id: 0a9f85caf65f431c96f27a7d04734211 Jun 23 13:46:02.368515 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Name: tempest-TestVolumeBootPattern-1088681018-project Jun 23 13:46:02.368515 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: method: > Jun 23 13:46:02.368515 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: exception: Instance 42c29e33-917a-4263-a80c-9863ed228875 could not be found. Jun 23 13:46:02.368515 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: action_args: {'id': '42c29e33-917a-4263-a80c-9863ed228875'} Jun 23 13:46:02.369439 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:46:02.369439 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:02.369439 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:46:02.369439 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:46:02.369439 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:46:02.369439 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:46:02.369439 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:46:02.369439 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:46:02.369439 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:46:02.369439 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:46:02.369439 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42c29e33-917a-4263-a80c-9863ed228875 could not be found. Jun 23 13:46:02.369439 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:02.369439 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:02.369439 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:02.369439 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:02.369439 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:02.369439 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:02.369439 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:46:02.369439 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:46:02.369439 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:46:02.370939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:46:02.370939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:46:02.370939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:46:02.370939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:46:02.370939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:46:02.370939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:46:02.370939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:46:02.370939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42c29e33-917a-4263-a80c-9863ed228875 could not be found. Jun 23 13:46:02.370939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:02.370939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:02.370939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:02.370939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:02.370939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:02.370939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:02.370939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:46:02.370939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:46:02.370939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42c29e33-917a-4263-a80c-9863ed228875 could not be found. Jun 23 13:46:02.370939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:02.373441 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-ccb97965-faeb-4e40-a1ce-05902a22c903 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Returning 404 to user: Instance 42c29e33-917a-4263-a80c-9863ed228875 could not be found. {{(pid=134666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:46:02.376227 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-ccb97965-faeb-4e40-a1ce-05902a22c903 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 404 len: 111 microversion: 2.1 time: 0.054133 Jun 23 13:46:02.377004 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 406/829] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:02 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:46:02.419852 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-e81928e4-c8c2-49a2-927c-1c6265d1d582 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:02.428704 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-e81928e4-c8c2-49a2-927c-1c6265d1d582 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:02.430219 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-e81928e4-c8c2-49a2-927c-1c6265d1d582 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:02.431420 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-e81928e4-c8c2-49a2-927c-1c6265d1d582 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1730 microversion: 2.20 time: 0.224649 Jun 23 13:46:02.435393 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 424/830] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:46:02 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1730 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:46:02.495194 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-b83b64fe-74c9-4083-bd04-517a02cef034 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-169196146", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1938430720", "security_groups": [{"name": "tempest-secgroup-smoke-6844620"}], "block_device_mapping_v2": [{"uuid": "efb25a77-a191-4d06-a7df-e4d325cfee17", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bb715288-0a54-4ca5-85b6-5a7823648ca0"}]}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:46:02.629094 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.network.neutron [None req-b83b64fe-74c9-4083-bd04-517a02cef034 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] validate_networks() for [('bb715288-0a54-4ca5-85b6-5a7823648ca0', None, None, None, None, None)] {{(pid=134666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 13:46:02.963134 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-354c084c-28d3-4629-a7fe-28e4590a9fb5 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:02.964110 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-354c084c-28d3-4629-a7fe-28e4590a9fb5 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] [instance: 75191b56-043b-4024-81a1-d0b1b33391ee] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:02.971908 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-354c084c-28d3-4629-a7fe-28e4590a9fb5 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:02.972863 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-354c084c-28d3-4629-a7fe-28e4590a9fb5 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:02.973856 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-354c084c-28d3-4629-a7fe-28e4590a9fb5 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:02.974482 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-354c084c-28d3-4629-a7fe-28e4590a9fb5 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:03.259251 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-354c084c-28d3-4629-a7fe-28e4590a9fb5 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd2882baad040019be3aa1e554c5905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc4a7159fa34affae55ebdbb866f88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:03.268866 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-b83b64fe-74c9-4083-bd04-517a02cef034 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Flavor limits 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 13:46:03.269285 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-b83b64fe-74c9-4083-bd04-517a02cef034 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Image limits 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 13:46:03.269753 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-b83b64fe-74c9-4083-bd04-517a02cef034 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Flavor pref 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 13:46:03.270190 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-b83b64fe-74c9-4083-bd04-517a02cef034 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Image pref 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 13:46:03.270839 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-b83b64fe-74c9-4083-bd04-517a02cef034 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 13:46:03.279516 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-354c084c-28d3-4629-a7fe-28e4590a9fb5 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] 10.222.0.26 "GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee" status: 200 len: 1285 microversion: 2.1 time: 0.317778 Jun 23 13:46:03.281933 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 425/831] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:02 2022] GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee => generated 1285 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:46:03.284599 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b83b64fe-74c9-4083-bd04-517a02cef034 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:03.285045 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b83b64fe-74c9-4083-bd04-517a02cef034 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:03.285823 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b83b64fe-74c9-4083-bd04-517a02cef034 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:03.286411 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b83b64fe-74c9-4083-bd04-517a02cef034 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:03.303821 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-b83b64fe-74c9-4083-bd04-517a02cef034 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Getting quotas for project 0d6c438e59834c4084c818053e1fdb93. Resources: {'ram', 'cores', 'instances'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:46:03.307886 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-b83b64fe-74c9-4083-bd04-517a02cef034 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Getting quotas for user 0a9f85caf65f431c96f27a7d04734211 and project 0d6c438e59834c4084c818053e1fdb93. Resources: {'ram', 'cores', 'instances'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:46:03.397479 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-b83b64fe-74c9-4083-bd04-517a02cef034 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Going to run 1 instances... {{(pid=134666) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 13:46:03.400739 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-b83b64fe-74c9-4083-bd04-517a02cef034 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='efb25a77-a191-4d06-a7df-e4d325cfee17',volume_size=None,volume_type=None)] {{(pid=134666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 13:46:03.457690 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-eae0e436-41b5-404a-9a49-27433426c9a6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:03.460920 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-eae0e436-41b5-404a-9a49-27433426c9a6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:03.487086 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-eae0e436-41b5-404a-9a49-27433426c9a6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:03.489434 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-eae0e436-41b5-404a-9a49-27433426c9a6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:03.490527 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-eae0e436-41b5-404a-9a49-27433426c9a6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:03.491366 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-eae0e436-41b5-404a-9a49-27433426c9a6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:03.587931 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-b83b64fe-74c9-4083-bd04-517a02cef034 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.097165 Jun 23 13:46:03.591479 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 407/832] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Jun 23 13:46:02 2022] POST /compute/v2.1/servers => generated 403 bytes in 1102 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 13:46:03.597798 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-84a1505a-6f1d-42e5-b598-afee8bf6d159 req-28d07e3b-f0f7-4b95-a2e6-4a7d5e8151fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a602a74c-fbf6-4ed0-85c6-f1778d879da7", "name": "network-vif-plugged", "status": "completed", "tag": "2a2fc7e3-801b-47fb-9626-bb5520448495"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:46:03.606529 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-84a1505a-6f1d-42e5-b598-afee8bf6d159 req-28d07e3b-f0f7-4b95-a2e6-4a7d5e8151fd service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:03.607879 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-84a1505a-6f1d-42e5-b598-afee8bf6d159 req-28d07e3b-f0f7-4b95-a2e6-4a7d5e8151fd service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:03.624791 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-84a1505a-6f1d-42e5-b598-afee8bf6d159 req-28d07e3b-f0f7-4b95-a2e6-4a7d5e8151fd service nova] Creating event network-vif-plugged:2a2fc7e3-801b-47fb-9626-bb5520448495 for instance a602a74c-fbf6-4ed0-85c6-f1778d879da7 on hv-cinder-81558 Jun 23 13:46:03.630377 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-84a1505a-6f1d-42e5-b598-afee8bf6d159 req-28d07e3b-f0f7-4b95-a2e6-4a7d5e8151fd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037388 Jun 23 13:46:03.631596 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 408/833] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:46:03.638340 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-dde168ec-11eb-4ce4-9501-b8f62f910856 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:03.639247 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-dde168ec-11eb-4ce4-9501-b8f62f910856 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:03.666123 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-eae0e436-41b5-404a-9a49-27433426c9a6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:03.674618 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-eae0e436-41b5-404a-9a49-27433426c9a6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:03.677279 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-eae0e436-41b5-404a-9a49-27433426c9a6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:03.678905 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-eae0e436-41b5-404a-9a49-27433426c9a6 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1730 microversion: 2.20 time: 0.232284 Jun 23 13:46:03.691065 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 426/834] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:46:03 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1730 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:46:03.707226 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-dde168ec-11eb-4ce4-9501-b8f62f910856 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:03.716338 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-dde168ec-11eb-4ce4-9501-b8f62f910856 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59" status: 200 len: 1094 microversion: 2.1 time: 0.082573 Jun 23 13:46:03.719764 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 409/835] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:03 2022] GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 => generated 1094 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:04.298611 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-a1897a92-8424-4f29-b53a-3f3a986dc9f4 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:04.299550 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-a1897a92-8424-4f29-b53a-3f3a986dc9f4 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] [instance: 75191b56-043b-4024-81a1-d0b1b33391ee] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:04.306411 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a1897a92-8424-4f29-b53a-3f3a986dc9f4 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:04.306869 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a1897a92-8424-4f29-b53a-3f3a986dc9f4 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:04.308238 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a1897a92-8424-4f29-b53a-3f3a986dc9f4 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:04.308755 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a1897a92-8424-4f29-b53a-3f3a986dc9f4 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:04.475371 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-a1897a92-8424-4f29-b53a-3f3a986dc9f4 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd2882baad040019be3aa1e554c5905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc4a7159fa34affae55ebdbb866f88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:04.485223 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-a1897a92-8424-4f29-b53a-3f3a986dc9f4 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] 10.222.0.26 "GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee" status: 200 len: 1315 microversion: 2.1 time: 0.191294 Jun 23 13:46:04.488647 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 427/836] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:04 2022] GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:04.638502 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-c792ca5b-b03e-4765-a18c-5c3105ec2b92 req-011243d1-2bba-400d-af87-fabb8f19ebde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75191b56-043b-4024-81a1-d0b1b33391ee", "tag": "329b604d-8767-4336-bdb4-15ab223f1fd5"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:46:04.650186 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-c792ca5b-b03e-4765-a18c-5c3105ec2b92 req-011243d1-2bba-400d-af87-fabb8f19ebde service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:04.650920 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-c792ca5b-b03e-4765-a18c-5c3105ec2b92 req-011243d1-2bba-400d-af87-fabb8f19ebde service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:04.666570 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-c792ca5b-b03e-4765-a18c-5c3105ec2b92 req-011243d1-2bba-400d-af87-fabb8f19ebde service nova] Creating event network-changed:329b604d-8767-4336-bdb4-15ab223f1fd5 for instance 75191b56-043b-4024-81a1-d0b1b33391ee on hv-cinder-81558 Jun 23 13:46:04.672601 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-c792ca5b-b03e-4765-a18c-5c3105ec2b92 req-011243d1-2bba-400d-af87-fabb8f19ebde service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038654 Jun 23 13:46:04.676531 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 410/837] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 13:46:04.699028 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-288694d9-4132-4e82-9735-f4b6b3b3f829 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:04.700993 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-288694d9-4132-4e82-9735-f4b6b3b3f829 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:04.708316 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-288694d9-4132-4e82-9735-f4b6b3b3f829 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:04.709019 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-288694d9-4132-4e82-9735-f4b6b3b3f829 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:04.709808 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-288694d9-4132-4e82-9735-f4b6b3b3f829 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:04.710255 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-288694d9-4132-4e82-9735-f4b6b3b3f829 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:04.734107 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-6ebed656-ae94-4309-916c-a88b5766bedc tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:04.735774 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-6ebed656-ae94-4309-916c-a88b5766bedc tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:04.744630 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6ebed656-ae94-4309-916c-a88b5766bedc tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:04.746102 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6ebed656-ae94-4309-916c-a88b5766bedc tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:04.747064 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6ebed656-ae94-4309-916c-a88b5766bedc tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:04.747674 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6ebed656-ae94-4309-916c-a88b5766bedc tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:04.821746 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-6ebed656-ae94-4309-916c-a88b5766bedc tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:04.829147 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-6ebed656-ae94-4309-916c-a88b5766bedc tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59" status: 200 len: 1192 microversion: 2.1 time: 0.099351 Jun 23 13:46:04.829713 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 411/838] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:04 2022] GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 => generated 1192 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:04.877862 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-288694d9-4132-4e82-9735-f4b6b3b3f829 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:04.888407 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-288694d9-4132-4e82-9735-f4b6b3b3f829 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:04.889944 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-288694d9-4132-4e82-9735-f4b6b3b3f829 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:04.891111 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-288694d9-4132-4e82-9735-f4b6b3b3f829 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1730 microversion: 2.20 time: 0.197237 Jun 23 13:46:04.891702 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 428/839] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:46:04 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1730 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:46:05.509959 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-20b97fc5-6e04-403f-bc5e-492de9b08a25 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:05.510573 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-20b97fc5-6e04-403f-bc5e-492de9b08a25 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] [instance: 75191b56-043b-4024-81a1-d0b1b33391ee] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:05.519211 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-20b97fc5-6e04-403f-bc5e-492de9b08a25 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:05.520049 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-20b97fc5-6e04-403f-bc5e-492de9b08a25 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:05.521158 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-20b97fc5-6e04-403f-bc5e-492de9b08a25 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:05.521811 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-20b97fc5-6e04-403f-bc5e-492de9b08a25 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:05.683024 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-20b97fc5-6e04-403f-bc5e-492de9b08a25 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd2882baad040019be3aa1e554c5905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc4a7159fa34affae55ebdbb866f88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:05.691629 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-20b97fc5-6e04-403f-bc5e-492de9b08a25 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] 10.222.0.26 "GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee" status: 200 len: 1315 microversion: 2.1 time: 0.189551 Jun 23 13:46:05.692197 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 412/840] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:05 2022] GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:05.846254 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-0a306a1c-0834-418e-a5c0-765caa87c237 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:05.846923 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-0a306a1c-0834-418e-a5c0-765caa87c237 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:05.853827 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0a306a1c-0834-418e-a5c0-765caa87c237 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:05.853827 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0a306a1c-0834-418e-a5c0-765caa87c237 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:05.854703 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0a306a1c-0834-418e-a5c0-765caa87c237 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:05.855092 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0a306a1c-0834-418e-a5c0-765caa87c237 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:05.909605 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-1265a06c-cc3a-45a5-b3b1-0d4c5d3e5bda tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:05.910847 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-1265a06c-cc3a-45a5-b3b1-0d4c5d3e5bda tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:05.926252 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1265a06c-cc3a-45a5-b3b1-0d4c5d3e5bda tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:05.926818 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1265a06c-cc3a-45a5-b3b1-0d4c5d3e5bda tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:05.933166 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1265a06c-cc3a-45a5-b3b1-0d4c5d3e5bda tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:05.933827 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1265a06c-cc3a-45a5-b3b1-0d4c5d3e5bda tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:05.942181 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-0a306a1c-0834-418e-a5c0-765caa87c237 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:05.950831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-0a306a1c-0834-418e-a5c0-765caa87c237 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59" status: 200 len: 1210 microversion: 2.1 time: 0.108399 Jun 23 13:46:05.952057 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 429/841] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:05 2022] GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 => generated 1210 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:06.085338 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-1265a06c-cc3a-45a5-b3b1-0d4c5d3e5bda tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:06.095865 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-1265a06c-cc3a-45a5-b3b1-0d4c5d3e5bda tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:06.097342 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-1265a06c-cc3a-45a5-b3b1-0d4c5d3e5bda tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:06.098501 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-1265a06c-cc3a-45a5-b3b1-0d4c5d3e5bda tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1717 microversion: 2.20 time: 0.193244 Jun 23 13:46:06.099462 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 413/842] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:46:05 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1717 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 13:46:06.710170 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-8c881a0b-cd71-4917-b1ba-ce50936b3615 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:06.710988 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-8c881a0b-cd71-4917-b1ba-ce50936b3615 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] [instance: 75191b56-043b-4024-81a1-d0b1b33391ee] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:06.718728 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8c881a0b-cd71-4917-b1ba-ce50936b3615 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:06.719189 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8c881a0b-cd71-4917-b1ba-ce50936b3615 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:06.719995 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8c881a0b-cd71-4917-b1ba-ce50936b3615 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:06.720438 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8c881a0b-cd71-4917-b1ba-ce50936b3615 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:06.855816 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-8c881a0b-cd71-4917-b1ba-ce50936b3615 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd2882baad040019be3aa1e554c5905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc4a7159fa34affae55ebdbb866f88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:06.866893 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-8c881a0b-cd71-4917-b1ba-ce50936b3615 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] 10.222.0.26 "GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee" status: 200 len: 1315 microversion: 2.1 time: 0.161948 Jun 23 13:46:06.867745 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 430/843] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:06 2022] GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:06.972099 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c38694b0-0f17-4949-8444-3f2ced5fd3c9 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:06.973543 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-c38694b0-0f17-4949-8444-3f2ced5fd3c9 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:06.981655 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c38694b0-0f17-4949-8444-3f2ced5fd3c9 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:06.982103 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c38694b0-0f17-4949-8444-3f2ced5fd3c9 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:06.982903 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c38694b0-0f17-4949-8444-3f2ced5fd3c9 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:06.983438 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c38694b0-0f17-4949-8444-3f2ced5fd3c9 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:07.126547 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-c38694b0-0f17-4949-8444-3f2ced5fd3c9 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:07.135466 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-c38694b0-0f17-4949-8444-3f2ced5fd3c9 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59" status: 200 len: 1275 microversion: 2.1 time: 0.167948 Jun 23 13:46:07.136495 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 414/844] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:06 2022] GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 => generated 1275 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:07.617115 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-d179730e-37cb-4573-9c71-2634ce5f45ca req-65051390-09ad-47bb-8a71-b5ab2b230b22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52cbfcd2-3b2d-44f2-a44d-55ab8868fd59", "tag": "b2540c58-97f9-4f0c-98c0-3f9877fc5e17"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:46:07.624189 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:07.643511 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-d179730e-37cb-4573-9c71-2634ce5f45ca req-65051390-09ad-47bb-8a71-b5ab2b230b22 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:07.645206 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-d179730e-37cb-4573-9c71-2634ce5f45ca req-65051390-09ad-47bb-8a71-b5ab2b230b22 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:07.683980 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-d179730e-37cb-4573-9c71-2634ce5f45ca req-65051390-09ad-47bb-8a71-b5ab2b230b22 service nova] Creating event network-changed:b2540c58-97f9-4f0c-98c0-3f9877fc5e17 for instance 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 on hv-cinder-81558 Jun 23 13:46:07.697754 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-d179730e-37cb-4573-9c71-2634ce5f45ca req-65051390-09ad-47bb-8a71-b5ab2b230b22 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082788 Jun 23 13:46:07.699286 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 431/845] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:46:07.886196 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-20976813-d483-4e7d-85a1-3096bd04dedf tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:07.887020 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-20976813-d483-4e7d-85a1-3096bd04dedf tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] [instance: 75191b56-043b-4024-81a1-d0b1b33391ee] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:07.896678 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-20976813-d483-4e7d-85a1-3096bd04dedf tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:07.897361 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-20976813-d483-4e7d-85a1-3096bd04dedf tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:07.898145 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-20976813-d483-4e7d-85a1-3096bd04dedf tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:07.898592 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-20976813-d483-4e7d-85a1-3096bd04dedf tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:07.951212 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-1cd98b3e-34fb-4963-945a-a4c6f9d3369a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:07.952608 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-1cd98b3e-34fb-4963-945a-a4c6f9d3369a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 7840b5d2-52e9-48db-95ba-af0fb4a5cb52] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:07.962589 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1cd98b3e-34fb-4963-945a-a4c6f9d3369a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:07.964263 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1cd98b3e-34fb-4963-945a-a4c6f9d3369a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:07.966997 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1cd98b3e-34fb-4963-945a-a4c6f9d3369a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:07.967846 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1cd98b3e-34fb-4963-945a-a4c6f9d3369a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:08.100537 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.objects.instance [None req-1cd98b3e-34fb-4963-945a-a4c6f9d3369a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lazy-loading 'services' on Instance uuid 7840b5d2-52e9-48db-95ba-af0fb4a5cb52 {{(pid=134667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:46:08.130826 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-20976813-d483-4e7d-85a1-3096bd04dedf tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd2882baad040019be3aa1e554c5905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc4a7159fa34affae55ebdbb866f88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:08.139634 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-20976813-d483-4e7d-85a1-3096bd04dedf tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] 10.222.0.26 "GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee" status: 200 len: 1315 microversion: 2.1 time: 0.257339 Jun 23 13:46:08.141974 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 415/846] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:07 2022] GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:08.152307 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-cfa21174-1466-45f3-8764-8cf52118ccda tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:08.153207 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-cfa21174-1466-45f3-8764-8cf52118ccda tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:08.159450 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-cfa21174-1466-45f3-8764-8cf52118ccda tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:08.160195 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-cfa21174-1466-45f3-8764-8cf52118ccda tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:08.161160 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-cfa21174-1466-45f3-8764-8cf52118ccda tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:08.161795 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-cfa21174-1466-45f3-8764-8cf52118ccda tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:08.191504 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-1cd98b3e-34fb-4963-945a-a4c6f9d3369a tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52/os-volume_attachments/5bfa73b8-b311-4add-9d78-b3b417eb7448" status: 202 len: 0 microversion: 2.1 time: 0.243924 Jun 23 13:46:08.192565 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 432/847] 10.222.0.26 () {58 vars in 1415 bytes} [Thu Jun 23 13:46:07 2022] DELETE /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52/os-volume_attachments/5bfa73b8-b311-4add-9d78-b3b417eb7448 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 13:46:08.202103 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-5b2c7efd-649c-4a0e-9083-3b4f58717fb7 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:08.203802 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-5b2c7efd-649c-4a0e-9083-3b4f58717fb7 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 7840b5d2-52e9-48db-95ba-af0fb4a5cb52] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:08.211545 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5b2c7efd-649c-4a0e-9083-3b4f58717fb7 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:08.212332 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5b2c7efd-649c-4a0e-9083-3b4f58717fb7 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:08.213172 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5b2c7efd-649c-4a0e-9083-3b4f58717fb7 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:08.213699 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5b2c7efd-649c-4a0e-9083-3b4f58717fb7 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:08.246837 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-5b2c7efd-649c-4a0e-9083-3b4f58717fb7 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049763 Jun 23 13:46:08.247628 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 433/848] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Jun 23 13:46:08 2022] GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:46:08.304051 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-cfa21174-1466-45f3-8764-8cf52118ccda tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:08.312144 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-cfa21174-1466-45f3-8764-8cf52118ccda tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59" status: 200 len: 1263 microversion: 2.1 time: 0.163637 Jun 23 13:46:08.312710 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 416/849] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:08 2022] GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 => generated 1263 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:46:09.156946 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-a32a8645-578c-46ba-b09b-9b157fbccea4 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:09.157529 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-a32a8645-578c-46ba-b09b-9b157fbccea4 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] [instance: 75191b56-043b-4024-81a1-d0b1b33391ee] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:09.164628 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a32a8645-578c-46ba-b09b-9b157fbccea4 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:09.165085 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a32a8645-578c-46ba-b09b-9b157fbccea4 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:09.165964 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a32a8645-578c-46ba-b09b-9b157fbccea4 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:09.166432 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a32a8645-578c-46ba-b09b-9b157fbccea4 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:09.259005 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-96d27aa3-2d1f-446a-93d0-d4111d42abf8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:09.260040 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-96d27aa3-2d1f-446a-93d0-d4111d42abf8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 7840b5d2-52e9-48db-95ba-af0fb4a5cb52] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:09.267567 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-96d27aa3-2d1f-446a-93d0-d4111d42abf8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:09.268283 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-96d27aa3-2d1f-446a-93d0-d4111d42abf8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:09.269266 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-96d27aa3-2d1f-446a-93d0-d4111d42abf8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:09.269733 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-96d27aa3-2d1f-446a-93d0-d4111d42abf8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:09.304661 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-96d27aa3-2d1f-446a-93d0-d4111d42abf8 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050205 Jun 23 13:46:09.310989 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 417/850] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Jun 23 13:46:09 2022] GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 13:46:09.316940 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-a32a8645-578c-46ba-b09b-9b157fbccea4 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd2882baad040019be3aa1e554c5905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc4a7159fa34affae55ebdbb866f88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:09.329817 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-a32a8645-578c-46ba-b09b-9b157fbccea4 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] 10.222.0.26 "GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee" status: 200 len: 1315 microversion: 2.1 time: 0.176803 Jun 23 13:46:09.331299 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 434/851] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:09 2022] GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:09.341063 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-9021b261-125f-4450-b79e-fb5909c1a50a tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:09.342482 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-9021b261-125f-4450-b79e-fb5909c1a50a tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:09.350188 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9021b261-125f-4450-b79e-fb5909c1a50a tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:09.350997 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9021b261-125f-4450-b79e-fb5909c1a50a tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:09.351800 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9021b261-125f-4450-b79e-fb5909c1a50a tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:09.352435 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9021b261-125f-4450-b79e-fb5909c1a50a tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:09.373892 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-e2a3b693-786f-4062-9d28-6650a7701965 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:09.374517 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-e2a3b693-786f-4062-9d28-6650a7701965 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 7840b5d2-52e9-48db-95ba-af0fb4a5cb52] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:09.380507 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e2a3b693-786f-4062-9d28-6650a7701965 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:09.381073 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e2a3b693-786f-4062-9d28-6650a7701965 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:09.381878 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e2a3b693-786f-4062-9d28-6650a7701965 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:09.382368 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e2a3b693-786f-4062-9d28-6650a7701965 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:09.409504 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-e2a3b693-786f-4062-9d28-6650a7701965 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 7840b5d2-52e9-48db-95ba-af0fb4a5cb52] Going to try to terminate instance {{(pid=134667) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 13:46:09.446530 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:09.493627 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-9021b261-125f-4450-b79e-fb5909c1a50a tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:09.499704 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-e2a3b693-786f-4062-9d28-6650a7701965 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52" status: 204 len: 0 microversion: 2.1 time: 0.129694 Jun 23 13:46:09.501147 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 435/852] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Jun 23 13:46:09 2022] DELETE /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 13:46:09.507090 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-9021b261-125f-4450-b79e-fb5909c1a50a tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59" status: 200 len: 1263 microversion: 2.1 time: 0.182030 Jun 23 13:46:09.508224 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-70c41ce9-0049-4dc5-8477-69ee5ac95893 req-9df40a97-ec7e-4586-85dc-6291f1f513b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75191b56-043b-4024-81a1-d0b1b33391ee", "name": "network-vif-plugged", "status": "completed", "tag": "329b604d-8767-4336-bdb4-15ab223f1fd5"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:46:09.509481 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 418/853] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:09 2022] GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 => generated 1263 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:46:09.515710 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-7e2abd88-5d80-4b92-93eb-c13f4a0b3342 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:09.516331 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-7e2abd88-5d80-4b92-93eb-c13f4a0b3342 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 7840b5d2-52e9-48db-95ba-af0fb4a5cb52] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:09.517546 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-70c41ce9-0049-4dc5-8477-69ee5ac95893 req-9df40a97-ec7e-4586-85dc-6291f1f513b2 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:09.518185 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-70c41ce9-0049-4dc5-8477-69ee5ac95893 req-9df40a97-ec7e-4586-85dc-6291f1f513b2 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:09.523122 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7e2abd88-5d80-4b92-93eb-c13f4a0b3342 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:09.523967 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7e2abd88-5d80-4b92-93eb-c13f4a0b3342 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:09.524757 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7e2abd88-5d80-4b92-93eb-c13f4a0b3342 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:09.525200 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7e2abd88-5d80-4b92-93eb-c13f4a0b3342 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:09.533012 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-70c41ce9-0049-4dc5-8477-69ee5ac95893 req-9df40a97-ec7e-4586-85dc-6291f1f513b2 service nova] Creating event network-vif-plugged:329b604d-8767-4336-bdb4-15ab223f1fd5 for instance 75191b56-043b-4024-81a1-d0b1b33391ee on hv-cinder-81558 Jun 23 13:46:09.537839 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-70c41ce9-0049-4dc5-8477-69ee5ac95893 req-9df40a97-ec7e-4586-85dc-6291f1f513b2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035121 Jun 23 13:46:09.538598 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 436/854] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:46:09.657167 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-7e2abd88-5d80-4b92-93eb-c13f4a0b3342 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:09.664892 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-7e2abd88-5d80-4b92-93eb-c13f4a0b3342 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52" status: 200 len: 1680 microversion: 2.1 time: 0.153806 Jun 23 13:46:09.665463 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 419/855] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:09 2022] GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:10.349930 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-4667c10e-66fb-418f-8711-284ffca905d3 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:10.350749 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-4667c10e-66fb-418f-8711-284ffca905d3 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] [instance: 75191b56-043b-4024-81a1-d0b1b33391ee] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:10.358284 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4667c10e-66fb-418f-8711-284ffca905d3 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:10.358730 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4667c10e-66fb-418f-8711-284ffca905d3 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:10.359592 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4667c10e-66fb-418f-8711-284ffca905d3 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:10.360023 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4667c10e-66fb-418f-8711-284ffca905d3 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:10.498557 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-4667c10e-66fb-418f-8711-284ffca905d3 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd2882baad040019be3aa1e554c5905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc4a7159fa34affae55ebdbb866f88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:10.506226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-4667c10e-66fb-418f-8711-284ffca905d3 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] 10.222.0.26 "GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee" status: 200 len: 1315 microversion: 2.1 time: 0.161941 Jun 23 13:46:10.506905 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 437/856] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:10 2022] GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:10.526576 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-cb810705-39b6-487d-b9e9-0b2d85ea03cb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:10.527486 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-cb810705-39b6-487d-b9e9-0b2d85ea03cb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:10.534298 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-cb810705-39b6-487d-b9e9-0b2d85ea03cb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:10.534827 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-cb810705-39b6-487d-b9e9-0b2d85ea03cb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:10.535717 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-cb810705-39b6-487d-b9e9-0b2d85ea03cb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:10.536159 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-cb810705-39b6-487d-b9e9-0b2d85ea03cb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:10.671740 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-cb810705-39b6-487d-b9e9-0b2d85ea03cb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:10.679546 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-cb810705-39b6-487d-b9e9-0b2d85ea03cb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59" status: 200 len: 1263 microversion: 2.1 time: 0.157720 Jun 23 13:46:10.680131 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 420/857] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:10 2022] GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:10.682876 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-b9c330eb-ad10-43f9-818f-37c98a004008 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:10.683633 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-b9c330eb-ad10-43f9-818f-37c98a004008 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 7840b5d2-52e9-48db-95ba-af0fb4a5cb52] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:10.690231 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b9c330eb-ad10-43f9-818f-37c98a004008 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:10.690794 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b9c330eb-ad10-43f9-818f-37c98a004008 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:10.691671 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b9c330eb-ad10-43f9-818f-37c98a004008 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:10.692146 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b9c330eb-ad10-43f9-818f-37c98a004008 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:10.830441 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-b9c330eb-ad10-43f9-818f-37c98a004008 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:10.841512 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-b9c330eb-ad10-43f9-818f-37c98a004008 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52" status: 200 len: 1680 microversion: 2.1 time: 0.162734 Jun 23 13:46:10.842384 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 438/858] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:10 2022] GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:11.522743 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-e07c1bd8-1f3e-4a5f-99a2-e73ff8ac947f tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:11.523476 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-e07c1bd8-1f3e-4a5f-99a2-e73ff8ac947f tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] [instance: 75191b56-043b-4024-81a1-d0b1b33391ee] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:11.529980 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e07c1bd8-1f3e-4a5f-99a2-e73ff8ac947f tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:11.530560 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e07c1bd8-1f3e-4a5f-99a2-e73ff8ac947f tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:11.531190 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e07c1bd8-1f3e-4a5f-99a2-e73ff8ac947f tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:11.531662 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e07c1bd8-1f3e-4a5f-99a2-e73ff8ac947f tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:11.662922 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-e07c1bd8-1f3e-4a5f-99a2-e73ff8ac947f tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd2882baad040019be3aa1e554c5905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc4a7159fa34affae55ebdbb866f88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:11.670688 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-e07c1bd8-1f3e-4a5f-99a2-e73ff8ac947f tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] 10.222.0.26 "GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee" status: 200 len: 1315 microversion: 2.1 time: 0.151876 Jun 23 13:46:11.671364 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 421/859] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:11 2022] GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:11.696375 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-177018a4-fe52-479b-be5d-6bfecf643505 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:11.696987 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-177018a4-fe52-479b-be5d-6bfecf643505 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:11.704010 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-177018a4-fe52-479b-be5d-6bfecf643505 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:11.704525 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-177018a4-fe52-479b-be5d-6bfecf643505 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:11.705367 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-177018a4-fe52-479b-be5d-6bfecf643505 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:11.706164 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-177018a4-fe52-479b-be5d-6bfecf643505 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:11.782204 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell0:SELECT=2 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:11.807257 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell0:SELECT=6 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:11.827817 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-2df78976-4c6b-4170-a300-6a7a895fc0ef tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:11.828513 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-2df78976-4c6b-4170-a300-6a7a895fc0ef tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:11.838033 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2df78976-4c6b-4170-a300-6a7a895fc0ef tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:11.838485 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2df78976-4c6b-4170-a300-6a7a895fc0ef tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:11.839812 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2df78976-4c6b-4170-a300-6a7a895fc0ef tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:11.840751 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2df78976-4c6b-4170-a300-6a7a895fc0ef tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:11.855300 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-177018a4-fe52-479b-be5d-6bfecf643505 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:11.863835 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-177018a4-fe52-479b-be5d-6bfecf643505 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59" status: 200 len: 1263 microversion: 2.1 time: 0.171338 Jun 23 13:46:11.864628 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 439/860] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:11 2022] GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 => generated 1263 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:11.870036 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-8255c434-9264-412b-9030-131611d7683e req-00448687-f856-4dfa-b580-a2a36ae62315 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89a0e254-8280-4e56-80e6-525cca5dcac3", "tag": "c680d421-4232-46b9-bea8-b492d2e2f651"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:46:11.881332 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-8255c434-9264-412b-9030-131611d7683e req-00448687-f856-4dfa-b580-a2a36ae62315 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:11.882805 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-8255c434-9264-412b-9030-131611d7683e req-00448687-f856-4dfa-b580-a2a36ae62315 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:11.883455 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-2df78976-4c6b-4170-a300-6a7a895fc0ef tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Going to try to terminate instance {{(pid=134666) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 13:46:11.896324 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-8255c434-9264-412b-9030-131611d7683e req-00448687-f856-4dfa-b580-a2a36ae62315 service nova] Creating event network-changed:c680d421-4232-46b9-bea8-b492d2e2f651 for instance 89a0e254-8280-4e56-80e6-525cca5dcac3 on hv-cinder-81558 Jun 23 13:46:11.901634 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-8255c434-9264-412b-9030-131611d7683e req-00448687-f856-4dfa-b580-a2a36ae62315 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035599 Jun 23 13:46:11.902649 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 440/861] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:46:11.911105 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-8c824cc7-3a49-4af7-bf83-66b0e9458f20 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:11.912227 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-8c824cc7-3a49-4af7-bf83-66b0e9458f20 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 7840b5d2-52e9-48db-95ba-af0fb4a5cb52] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:11.919885 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8c824cc7-3a49-4af7-bf83-66b0e9458f20 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:11.920384 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8c824cc7-3a49-4af7-bf83-66b0e9458f20 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:11.921226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8c824cc7-3a49-4af7-bf83-66b0e9458f20 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:11.921673 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8c824cc7-3a49-4af7-bf83-66b0e9458f20 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:12.015172 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-2df78976-4c6b-4170-a300-6a7a895fc0ef tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "DELETE /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 204 len: 0 microversion: 2.1 time: 0.192652 Jun 23 13:46:12.015961 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 422/862] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Jun 23 13:46:11 2022] DELETE /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 13:46:12.045234 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-35c42a39-7ffe-467e-ac28-4b7cc0f1ed29 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:12.046124 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-35c42a39-7ffe-467e-ac28-4b7cc0f1ed29 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:12.057415 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-35c42a39-7ffe-467e-ac28-4b7cc0f1ed29 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:12.057932 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-35c42a39-7ffe-467e-ac28-4b7cc0f1ed29 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:12.058773 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-35c42a39-7ffe-467e-ac28-4b7cc0f1ed29 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:12.059267 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-35c42a39-7ffe-467e-ac28-4b7cc0f1ed29 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:12.064981 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:12.097726 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-8c824cc7-3a49-4af7-bf83-66b0e9458f20 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:12.110158 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-8c824cc7-3a49-4af7-bf83-66b0e9458f20 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52" status: 200 len: 1680 microversion: 2.1 time: 0.205998 Jun 23 13:46:12.121123 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 441/863] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:11 2022] GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52 => generated 1680 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:12.220526 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-35c42a39-7ffe-467e-ac28-4b7cc0f1ed29 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:12.236706 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-35c42a39-7ffe-467e-ac28-4b7cc0f1ed29 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1567 microversion: 2.1 time: 0.215934 Jun 23 13:46:12.237588 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 423/864] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:12 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1567 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:12.690224 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-9442a2a0-a38e-4ae5-bf45-e12f6086d7a0 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:12.690848 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-9442a2a0-a38e-4ae5-bf45-e12f6086d7a0 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] [instance: 75191b56-043b-4024-81a1-d0b1b33391ee] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:12.697735 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9442a2a0-a38e-4ae5-bf45-e12f6086d7a0 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:12.698324 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9442a2a0-a38e-4ae5-bf45-e12f6086d7a0 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:12.699004 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9442a2a0-a38e-4ae5-bf45-e12f6086d7a0 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:12.699495 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9442a2a0-a38e-4ae5-bf45-e12f6086d7a0 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:12.836937 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-9442a2a0-a38e-4ae5-bf45-e12f6086d7a0 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd2882baad040019be3aa1e554c5905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc4a7159fa34affae55ebdbb866f88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:12.844841 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-9442a2a0-a38e-4ae5-bf45-e12f6086d7a0 tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] 10.222.0.26 "GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee" status: 200 len: 1315 microversion: 2.1 time: 0.158513 Jun 23 13:46:12.845524 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 442/865] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:12 2022] GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:12.880567 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-a41ca3e3-b00e-4318-a452-69a5e2ac0e89 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:12.881292 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-a41ca3e3-b00e-4318-a452-69a5e2ac0e89 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:12.887974 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a41ca3e3-b00e-4318-a452-69a5e2ac0e89 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:12.888547 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a41ca3e3-b00e-4318-a452-69a5e2ac0e89 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:12.889384 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a41ca3e3-b00e-4318-a452-69a5e2ac0e89 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:12.889818 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a41ca3e3-b00e-4318-a452-69a5e2ac0e89 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:13.031852 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-a41ca3e3-b00e-4318-a452-69a5e2ac0e89 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:13.039427 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-a41ca3e3-b00e-4318-a452-69a5e2ac0e89 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59" status: 200 len: 1263 microversion: 2.1 time: 0.162886 Jun 23 13:46:13.040015 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 424/866] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:12 2022] GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:13.127798 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-c8527f10-49e7-4523-ab23-a418f763d8c1 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:13.128409 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-c8527f10-49e7-4523-ab23-a418f763d8c1 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 7840b5d2-52e9-48db-95ba-af0fb4a5cb52] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:13.134752 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c8527f10-49e7-4523-ab23-a418f763d8c1 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:13.135203 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c8527f10-49e7-4523-ab23-a418f763d8c1 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:13.136009 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c8527f10-49e7-4523-ab23-a418f763d8c1 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:13.136471 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c8527f10-49e7-4523-ab23-a418f763d8c1 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:13.206692 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-c8527f10-49e7-4523-ab23-a418f763d8c1 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:13.216719 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-c8527f10-49e7-4523-ab23-a418f763d8c1 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52" status: 200 len: 1613 microversion: 2.1 time: 0.092852 Jun 23 13:46:13.227100 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 443/867] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:13 2022] GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52 => generated 1613 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:13.254101 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-26bdc5a5-a258-4705-949d-a8d4fe733ca9 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:13.254853 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-26bdc5a5-a258-4705-949d-a8d4fe733ca9 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:13.261131 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-26bdc5a5-a258-4705-949d-a8d4fe733ca9 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:13.261569 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-26bdc5a5-a258-4705-949d-a8d4fe733ca9 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:13.262326 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-26bdc5a5-a258-4705-949d-a8d4fe733ca9 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:13.265095 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-26bdc5a5-a258-4705-949d-a8d4fe733ca9 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:13.299862 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell0:SELECT=2 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:13.437173 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-26bdc5a5-a258-4705-949d-a8d4fe733ca9 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:13.445281 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-26bdc5a5-a258-4705-949d-a8d4fe733ca9 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1567 microversion: 2.1 time: 0.195025 Jun 23 13:46:13.456204 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 425/868] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:13 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:13.862126 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-d9a254b4-028b-449f-ae44-98a1bf291f4f tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:13.862767 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-d9a254b4-028b-449f-ae44-98a1bf291f4f tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] [instance: 75191b56-043b-4024-81a1-d0b1b33391ee] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:13.869257 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d9a254b4-028b-449f-ae44-98a1bf291f4f tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:13.869706 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d9a254b4-028b-449f-ae44-98a1bf291f4f tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:13.870460 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d9a254b4-028b-449f-ae44-98a1bf291f4f tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:13.870891 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d9a254b4-028b-449f-ae44-98a1bf291f4f tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:13.922574 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-5a67b3dc-4423-4e2d-8ff3-99945efdfbd7 req-1b9cd6f2-9c4c-4df1-a863-58f1fc099ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7840b5d2-52e9-48db-95ba-af0fb4a5cb52", "name": "network-vif-deleted", "tag": "babf77e6-6bb7-4c15-be55-0aff77abfe3f"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:46:13.927759 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell0:SELECT=10 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:13.935862 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-5a67b3dc-4423-4e2d-8ff3-99945efdfbd7 req-1b9cd6f2-9c4c-4df1-a863-58f1fc099ee6 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:13.936299 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-5a67b3dc-4423-4e2d-8ff3-99945efdfbd7 req-1b9cd6f2-9c4c-4df1-a863-58f1fc099ee6 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:13.948333 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-5a67b3dc-4423-4e2d-8ff3-99945efdfbd7 req-1b9cd6f2-9c4c-4df1-a863-58f1fc099ee6 service nova] Creating event network-vif-deleted:babf77e6-6bb7-4c15-be55-0aff77abfe3f for instance 7840b5d2-52e9-48db-95ba-af0fb4a5cb52 on hv-cinder-81558 Jun 23 13:46:13.955248 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-5a67b3dc-4423-4e2d-8ff3-99945efdfbd7 req-1b9cd6f2-9c4c-4df1-a863-58f1fc099ee6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036738 Jun 23 13:46:13.956951 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 426/869] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:46:14.014774 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-d9a254b4-028b-449f-ae44-98a1bf291f4f tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd2882baad040019be3aa1e554c5905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc4a7159fa34affae55ebdbb866f88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:14.022890 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-d9a254b4-028b-449f-ae44-98a1bf291f4f tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] 10.222.0.26 "GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee" status: 200 len: 1465 microversion: 2.1 time: 0.164958 Jun 23 13:46:14.023500 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 444/870] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:13 2022] GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee => generated 1465 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:14.056936 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-1f6efe47-6d19-46d9-9ae9-82befad563c8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:14.057628 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-1f6efe47-6d19-46d9-9ae9-82befad563c8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:14.064741 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1f6efe47-6d19-46d9-9ae9-82befad563c8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:14.065495 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1f6efe47-6d19-46d9-9ae9-82befad563c8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:14.066481 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1f6efe47-6d19-46d9-9ae9-82befad563c8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:14.066896 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1f6efe47-6d19-46d9-9ae9-82befad563c8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:14.077266 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-bc6ccfa6-4b60-4c23-a263-569c8abcc0ee tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:14.077762 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-bc6ccfa6-4b60-4c23-a263-569c8abcc0ee tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] [instance: 75191b56-043b-4024-81a1-d0b1b33391ee] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:14.084468 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bc6ccfa6-4b60-4c23-a263-569c8abcc0ee tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:14.084922 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bc6ccfa6-4b60-4c23-a263-569c8abcc0ee tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:14.085695 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bc6ccfa6-4b60-4c23-a263-569c8abcc0ee tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:14.086165 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bc6ccfa6-4b60-4c23-a263-569c8abcc0ee tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:14.113958 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-bc6ccfa6-4b60-4c23-a263-569c8abcc0ee tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] [instance: 75191b56-043b-4024-81a1-d0b1b33391ee] Going to try to terminate instance {{(pid=134667) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 13:46:14.190837 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-bc6ccfa6-4b60-4c23-a263-569c8abcc0ee tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] 10.222.0.26 "DELETE /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee" status: 204 len: 0 microversion: 2.1 time: 0.117166 Jun 23 13:46:14.191584 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 445/871] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Jun 23 13:46:14 2022] DELETE /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 13:46:14.200855 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-9a477acc-962a-4e3c-9508-cca40d2a92fb tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:14.201562 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-9a477acc-962a-4e3c-9508-cca40d2a92fb tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] [instance: 75191b56-043b-4024-81a1-d0b1b33391ee] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:14.207701 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9a477acc-962a-4e3c-9508-cca40d2a92fb tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:14.208154 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9a477acc-962a-4e3c-9508-cca40d2a92fb tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:14.208931 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9a477acc-962a-4e3c-9508-cca40d2a92fb tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:14.209384 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9a477acc-962a-4e3c-9508-cca40d2a92fb tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:14.215087 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-1f6efe47-6d19-46d9-9ae9-82befad563c8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:14.222878 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-1f6efe47-6d19-46d9-9ae9-82befad563c8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59" status: 200 len: 1263 microversion: 2.1 time: 0.170308 Jun 23 13:46:14.223656 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 427/872] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:14 2022] GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 => generated 1263 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:14.236595 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-d03195ee-efff-4571-8139-a14051581ae3 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:14.237207 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-d03195ee-efff-4571-8139-a14051581ae3 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 7840b5d2-52e9-48db-95ba-af0fb4a5cb52] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:14.239192 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:14.244573 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d03195ee-efff-4571-8139-a14051581ae3 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:14.245021 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d03195ee-efff-4571-8139-a14051581ae3 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:14.245789 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d03195ee-efff-4571-8139-a14051581ae3 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:14.246224 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d03195ee-efff-4571-8139-a14051581ae3 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:14.278796 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d03195ee-efff-4571-8139-a14051581ae3 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:14.279121 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d03195ee-efff-4571-8139-a14051581ae3 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:14.279596 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.objects.instance [None req-d03195ee-efff-4571-8139-a14051581ae3 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lazy-loading 'fault' on Instance uuid 7840b5d2-52e9-48db-95ba-af0fb4a5cb52 {{(pid=134666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:46:14.341639 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-d03195ee-efff-4571-8139-a14051581ae3 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:14.349079 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-d03195ee-efff-4571-8139-a14051581ae3 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52" status: 200 len: 1330 microversion: 2.1 time: 0.116092 Jun 23 13:46:14.349641 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 428/873] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:14 2022] GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52 => generated 1330 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:14.370642 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-9a477acc-962a-4e3c-9508-cca40d2a92fb tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd2882baad040019be3aa1e554c5905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc4a7159fa34affae55ebdbb866f88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:14.378685 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-9a477acc-962a-4e3c-9508-cca40d2a92fb tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] 10.222.0.26 "GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee" status: 200 len: 1471 microversion: 2.1 time: 0.182220 Jun 23 13:46:14.379223 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 446/874] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:14 2022] GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee => generated 1471 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:14.467459 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-2d81fbdf-0711-493c-aba6-7e8a897ccd1f tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:14.468181 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-2d81fbdf-0711-493c-aba6-7e8a897ccd1f tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:14.475988 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2d81fbdf-0711-493c-aba6-7e8a897ccd1f tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:14.476554 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2d81fbdf-0711-493c-aba6-7e8a897ccd1f tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:14.477501 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2d81fbdf-0711-493c-aba6-7e8a897ccd1f tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:14.478040 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2d81fbdf-0711-493c-aba6-7e8a897ccd1f tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:14.628324 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-2d81fbdf-0711-493c-aba6-7e8a897ccd1f tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:14.636116 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-2d81fbdf-0711-493c-aba6-7e8a897ccd1f tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1567 microversion: 2.1 time: 0.174714 Jun 23 13:46:14.636671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 429/875] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:14 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:15.243875 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-5ec0a91b-7bde-4d4f-a98f-7e4a312482d6 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:15.244847 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-5ec0a91b-7bde-4d4f-a98f-7e4a312482d6 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:15.253103 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5ec0a91b-7bde-4d4f-a98f-7e4a312482d6 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:15.253586 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5ec0a91b-7bde-4d4f-a98f-7e4a312482d6 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:15.254419 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5ec0a91b-7bde-4d4f-a98f-7e4a312482d6 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:15.254901 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5ec0a91b-7bde-4d4f-a98f-7e4a312482d6 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:15.367166 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-e55ef703-7fe1-4707-b44a-d95e54cd1df2 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:15.367873 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-e55ef703-7fe1-4707-b44a-d95e54cd1df2 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 7840b5d2-52e9-48db-95ba-af0fb4a5cb52] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:15.375461 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e55ef703-7fe1-4707-b44a-d95e54cd1df2 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:15.376003 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e55ef703-7fe1-4707-b44a-d95e54cd1df2 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:15.377075 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e55ef703-7fe1-4707-b44a-d95e54cd1df2 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:15.377592 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e55ef703-7fe1-4707-b44a-d95e54cd1df2 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:15.400352 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-5ec0a91b-7bde-4d4f-a98f-7e4a312482d6 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:15.408335 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-5ec0a91b-7bde-4d4f-a98f-7e4a312482d6 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59" status: 200 len: 1263 microversion: 2.1 time: 0.171023 Jun 23 13:46:15.408925 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 447/876] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:15 2022] GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 => generated 1263 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:15.413710 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e55ef703-7fe1-4707-b44a-d95e54cd1df2 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:15.414148 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-3228feac-85f0-4f4a-97c7-ffddf469d1fe tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:15.414355 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e55ef703-7fe1-4707-b44a-d95e54cd1df2 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:15.414903 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.objects.instance [None req-e55ef703-7fe1-4707-b44a-d95e54cd1df2 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lazy-loading 'fault' on Instance uuid 7840b5d2-52e9-48db-95ba-af0fb4a5cb52 {{(pid=134666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:46:15.415270 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-3228feac-85f0-4f4a-97c7-ffddf469d1fe tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] [instance: 75191b56-043b-4024-81a1-d0b1b33391ee] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:15.422796 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3228feac-85f0-4f4a-97c7-ffddf469d1fe tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:15.423396 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3228feac-85f0-4f4a-97c7-ffddf469d1fe tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:15.424320 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3228feac-85f0-4f4a-97c7-ffddf469d1fe tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:15.424769 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3228feac-85f0-4f4a-97c7-ffddf469d1fe tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:15.466782 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-e55ef703-7fe1-4707-b44a-d95e54cd1df2 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007ce9b8109343e0914efe94c6aa6a89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9298bf4635e84993b086309715cc7cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:15.475026 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-e55ef703-7fe1-4707-b44a-d95e54cd1df2 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52" status: 200 len: 1330 microversion: 2.1 time: 0.112550 Jun 23 13:46:15.477966 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 430/877] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:15 2022] GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52 => generated 1330 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:15.559111 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-3228feac-85f0-4f4a-97c7-ffddf469d1fe tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd2882baad040019be3aa1e554c5905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc4a7159fa34affae55ebdbb866f88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:15.566991 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-3228feac-85f0-4f4a-97c7-ffddf469d1fe tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] 10.222.0.26 "GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee" status: 200 len: 1471 microversion: 2.1 time: 0.156847 Jun 23 13:46:15.567595 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 448/878] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:15 2022] GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee => generated 1471 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:15.656126 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-243d79d0-848d-4e7e-9b29-069124ed8e42 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:15.657013 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-243d79d0-848d-4e7e-9b29-069124ed8e42 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:15.665484 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-243d79d0-848d-4e7e-9b29-069124ed8e42 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:15.666136 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-243d79d0-848d-4e7e-9b29-069124ed8e42 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:15.667220 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-243d79d0-848d-4e7e-9b29-069124ed8e42 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:15.667892 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-243d79d0-848d-4e7e-9b29-069124ed8e42 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:15.799490 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-243d79d0-848d-4e7e-9b29-069124ed8e42 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:15.807750 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-243d79d0-848d-4e7e-9b29-069124ed8e42 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1567 microversion: 2.1 time: 0.157202 Jun 23 13:46:15.808329 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 431/879] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:15 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:16.425404 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-153f55cc-31cb-4e1a-abf5-fe9af693de8d tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:16.425966 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-153f55cc-31cb-4e1a-abf5-fe9af693de8d tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:16.432655 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-153f55cc-31cb-4e1a-abf5-fe9af693de8d tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:16.433107 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-153f55cc-31cb-4e1a-abf5-fe9af693de8d tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:16.433871 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-153f55cc-31cb-4e1a-abf5-fe9af693de8d tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:16.434306 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-153f55cc-31cb-4e1a-abf5-fe9af693de8d tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:16.492308 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-7f27b627-3997-4abd-a668-3b9ff8aa21dc tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:16.493060 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-7f27b627-3997-4abd-a668-3b9ff8aa21dc tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 7840b5d2-52e9-48db-95ba-af0fb4a5cb52] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:16.499962 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7f27b627-3997-4abd-a668-3b9ff8aa21dc tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:16.500413 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7f27b627-3997-4abd-a668-3b9ff8aa21dc tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:16.501414 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7f27b627-3997-4abd-a668-3b9ff8aa21dc tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:16.501820 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-7f27b627-3997-4abd-a668-3b9ff8aa21dc tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:16.516203 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.wsgi [None req-7f27b627-3997-4abd-a668-3b9ff8aa21dc tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] HTTP exception thrown: Instance 7840b5d2-52e9-48db-95ba-af0fb4a5cb52 could not be found. Jun 23 13:46:16.517921 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-7f27b627-3997-4abd-a668-3b9ff8aa21dc tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Request method failure captured: Jun 23 13:46:16.517921 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: request: GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52 HTTP/1.1 Jun 23 13:46:16.517921 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept: application/json Jun 23 13:46:16.517921 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept-Encoding: identity Jun 23 13:46:16.517921 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Connection: close Jun 23 13:46:16.517921 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Length: 0 Jun 23 13:46:16.517921 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Type: application/json Jun 23 13:46:16.517921 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Host: 10.222.0.26 Jun 23 13:46:16.517921 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Openstack-System-Scope: None Jun 23 13:46:16.517921 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: User-Agent: python-urllib3/1.26.9 Jun 23 13:46:16.517921 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Auth-Token: gAAAAABitG0I_HZU131M8J85RvEQOmj8LgA_2WxO2JHaCALyqdLluOOVQseCnN3b49kmuLUwl7kgpYu_nyCOuFs2D4nvXDzPB-BFMJHg1SH6Biig2M0dk2RuXu07iB9rawZfYchoQTmmnBEWqWi0vz9e6Q6R4kGGzJ8cvnvjbn-HCeyXQcr5f7s Jun 23 13:46:16.517921 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Id: None Jun 23 13:46:16.517921 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Name: None Jun 23 13:46:16.517921 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Identity-Status: Confirmed Jun 23 13:46:16.517921 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Is-Admin-Project: True Jun 23 13:46:16.517921 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Id: default Jun 23 13:46:16.517921 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Name: Default Jun 23 13:46:16.517921 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Id: 9298bf4635e84993b086309715cc7cbe Jun 23 13:46:16.517921 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Name: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:46:16.517921 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Role: member,reader Jun 23 13:46:16.517921 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Roles: member,reader Jun 23 13:46:16.519535 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9298bf4635e84993b086309715cc7cbe", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:46:16.519535 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:46:16.519535 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Id: 9298bf4635e84993b086309715cc7cbe Jun 23 13:46:16.519535 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:46:16.519535 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User: tempest-AttachVolumeNegativeTest-1741631114-project Jun 23 13:46:16.519535 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Id: default Jun 23 13:46:16.519535 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Name: Default Jun 23 13:46:16.519535 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Id: 007ce9b8109343e0914efe94c6aa6a89 Jun 23 13:46:16.519535 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Name: tempest-AttachVolumeNegativeTest-1741631114-project Jun 23 13:46:16.519535 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: method: > Jun 23 13:46:16.519535 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: exception: Instance 7840b5d2-52e9-48db-95ba-af0fb4a5cb52 could not be found. Jun 23 13:46:16.519535 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: action_args: {'id': '7840b5d2-52e9-48db-95ba-af0fb4a5cb52'} Jun 23 13:46:16.520470 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:46:16.520470 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:16.520470 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:46:16.520470 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:46:16.520470 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:46:16.520470 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:46:16.520470 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:46:16.520470 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:46:16.520470 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:46:16.520470 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:46:16.520470 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7840b5d2-52e9-48db-95ba-af0fb4a5cb52 could not be found. Jun 23 13:46:16.520470 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:16.520470 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:16.520470 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:16.520470 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:16.520470 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:16.520470 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:16.520470 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:46:16.520470 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:46:16.520470 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:46:16.522381 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:46:16.522381 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:46:16.522381 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:46:16.522381 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:46:16.522381 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:46:16.522381 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:46:16.522381 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:46:16.522381 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7840b5d2-52e9-48db-95ba-af0fb4a5cb52 could not be found. Jun 23 13:46:16.522381 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:16.522381 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:16.522381 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:16.522381 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:16.522381 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:16.522381 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:16.522381 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:46:16.522381 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:46:16.522381 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7840b5d2-52e9-48db-95ba-af0fb4a5cb52 could not be found. Jun 23 13:46:16.522381 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:16.524876 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-7f27b627-3997-4abd-a668-3b9ff8aa21dc tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Returning 404 to user: Instance 7840b5d2-52e9-48db-95ba-af0fb4a5cb52 could not be found. {{(pid=134666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:46:16.525929 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-7f27b627-3997-4abd-a668-3b9ff8aa21dc tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52" status: 404 len: 111 microversion: 2.1 time: 0.037533 Jun 23 13:46:16.526525 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 432/880] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:16 2022] GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:46:16.535538 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-22042e91-22da-4a79-b8a9-558f30ba63d4 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '.version_select at 0x7fd7722f0790>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:16.559306 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-22042e91-22da-4a79-b8a9-558f30ba63d4 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-240769615" status: 202 len: 0 microversion: 2.1 time: 0.027681 Jun 23 13:46:16.563164 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 433/881] 10.222.0.26 () {58 vars in 1217 bytes} [Thu Jun 23 13:46:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-240769615 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 13:46:16.585523 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c7606d25-c072-43c7-93a6-654d5ccfbc1b tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:16.586145 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-c7606d25-c072-43c7-93a6-654d5ccfbc1b tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] [instance: 75191b56-043b-4024-81a1-d0b1b33391ee] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:16.593522 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c7606d25-c072-43c7-93a6-654d5ccfbc1b tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:16.593964 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c7606d25-c072-43c7-93a6-654d5ccfbc1b tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:16.594732 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c7606d25-c072-43c7-93a6-654d5ccfbc1b tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:16.595166 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c7606d25-c072-43c7-93a6-654d5ccfbc1b tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:16.623557 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-153f55cc-31cb-4e1a-abf5-fe9af693de8d tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:16.637637 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-153f55cc-31cb-4e1a-abf5-fe9af693de8d tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59" status: 200 len: 1263 microversion: 2.1 time: 0.215816 Jun 23 13:46:16.638519 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 449/882] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:16 2022] GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 => generated 1263 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:16.800737 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-c7606d25-c072-43c7-93a6-654d5ccfbc1b tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd2882baad040019be3aa1e554c5905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc4a7159fa34affae55ebdbb866f88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:16.809977 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-c7606d25-c072-43c7-93a6-654d5ccfbc1b tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] 10.222.0.26 "GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee" status: 200 len: 1471 microversion: 2.1 time: 0.229349 Jun 23 13:46:16.810977 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 434/883] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:16 2022] GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee => generated 1471 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:16.826651 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-8cc7e9a3-2c58-4af1-931e-98ad86234e1b tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:16.827405 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-8cc7e9a3-2c58-4af1-931e-98ad86234e1b tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:16.834624 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8cc7e9a3-2c58-4af1-931e-98ad86234e1b tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:16.835210 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8cc7e9a3-2c58-4af1-931e-98ad86234e1b tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:16.836093 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8cc7e9a3-2c58-4af1-931e-98ad86234e1b tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:16.836591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8cc7e9a3-2c58-4af1-931e-98ad86234e1b tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:17.112347 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-8cc7e9a3-2c58-4af1-931e-98ad86234e1b tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:17.127592 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-8cc7e9a3-2c58-4af1-931e-98ad86234e1b tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1448 microversion: 2.1 time: 0.305457 Jun 23 13:46:17.130053 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 450/884] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:16 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1448 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:17.178284 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-1bca66af-4ed3-4f76-9857-5b886a053ff2 req-5e9f0366-67c1-4ce6-8fa3-1dba0bec962d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89a0e254-8280-4e56-80e6-525cca5dcac3", "name": "network-vif-deleted", "tag": "c680d421-4232-46b9-bea8-b492d2e2f651"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:46:17.192111 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-1bca66af-4ed3-4f76-9857-5b886a053ff2 req-5e9f0366-67c1-4ce6-8fa3-1dba0bec962d service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:17.193057 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-1bca66af-4ed3-4f76-9857-5b886a053ff2 req-5e9f0366-67c1-4ce6-8fa3-1dba0bec962d service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:17.210406 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-1bca66af-4ed3-4f76-9857-5b886a053ff2 req-5e9f0366-67c1-4ce6-8fa3-1dba0bec962d service nova] Creating event network-vif-deleted:c680d421-4232-46b9-bea8-b492d2e2f651 for instance 89a0e254-8280-4e56-80e6-525cca5dcac3 on hv-cinder-81558 Jun 23 13:46:17.219267 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-1bca66af-4ed3-4f76-9857-5b886a053ff2 req-5e9f0366-67c1-4ce6-8fa3-1dba0bec962d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044894 Jun 23 13:46:17.220533 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 435/885] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:46:17.586716 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-6be1732d-1c50-414c-8fe3-4cf891121b21 req-90b50998-68fd-406b-985a-b4848ed484b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52cbfcd2-3b2d-44f2-a44d-55ab8868fd59", "name": "network-vif-plugged", "status": "completed", "tag": "b2540c58-97f9-4f0c-98c0-3f9877fc5e17"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:46:17.596054 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-6be1732d-1c50-414c-8fe3-4cf891121b21 req-90b50998-68fd-406b-985a-b4848ed484b7 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:17.596500 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-6be1732d-1c50-414c-8fe3-4cf891121b21 req-90b50998-68fd-406b-985a-b4848ed484b7 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:17.615047 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-6be1732d-1c50-414c-8fe3-4cf891121b21 req-90b50998-68fd-406b-985a-b4848ed484b7 service nova] Creating event network-vif-plugged:b2540c58-97f9-4f0c-98c0-3f9877fc5e17 for instance 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 on hv-cinder-81558 Jun 23 13:46:17.622468 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-6be1732d-1c50-414c-8fe3-4cf891121b21 req-90b50998-68fd-406b-985a-b4848ed484b7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038763 Jun 23 13:46:17.623022 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 451/886] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:46:17.655803 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-3d7bd537-7a3f-4e30-afb3-55b1dbaad274 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:17.657287 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-3d7bd537-7a3f-4e30-afb3-55b1dbaad274 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:17.664952 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3d7bd537-7a3f-4e30-afb3-55b1dbaad274 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:17.665702 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3d7bd537-7a3f-4e30-afb3-55b1dbaad274 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:17.666478 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3d7bd537-7a3f-4e30-afb3-55b1dbaad274 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:17.666916 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3d7bd537-7a3f-4e30-afb3-55b1dbaad274 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:17.824585 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-3d7bd537-7a3f-4e30-afb3-55b1dbaad274 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:17.828336 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-a5b25029-822b-4b8c-bfc6-0e5d3663d2fd tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:17.829607 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-a5b25029-822b-4b8c-bfc6-0e5d3663d2fd tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] [instance: 75191b56-043b-4024-81a1-d0b1b33391ee] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:17.836342 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-3d7bd537-7a3f-4e30-afb3-55b1dbaad274 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59" status: 200 len: 1263 microversion: 2.1 time: 0.185549 Jun 23 13:46:17.837581 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 436/887] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:17 2022] GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 => generated 1263 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:17.838906 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a5b25029-822b-4b8c-bfc6-0e5d3663d2fd tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:17.839643 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a5b25029-822b-4b8c-bfc6-0e5d3663d2fd tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:17.840793 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a5b25029-822b-4b8c-bfc6-0e5d3663d2fd tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:17.841492 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a5b25029-822b-4b8c-bfc6-0e5d3663d2fd tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:17.846789 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:17.878959 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a5b25029-822b-4b8c-bfc6-0e5d3663d2fd tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:17.879702 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a5b25029-822b-4b8c-bfc6-0e5d3663d2fd tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:17.880310 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.objects.instance [None req-a5b25029-822b-4b8c-bfc6-0e5d3663d2fd tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lazy-loading 'fault' on Instance uuid 75191b56-043b-4024-81a1-d0b1b33391ee {{(pid=134667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:46:17.926892 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-a5b25029-822b-4b8c-bfc6-0e5d3663d2fd tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cd2882baad040019be3aa1e554c5905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bc4a7159fa34affae55ebdbb866f88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:17.934970 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-a5b25029-822b-4b8c-bfc6-0e5d3663d2fd tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] 10.222.0.26 "GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee" status: 200 len: 1305 microversion: 2.1 time: 0.111644 Jun 23 13:46:17.936869 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 452/888] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:17 2022] GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee => generated 1305 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:18.145896 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-70093126-feb0-4cda-b7c7-8c642d02dd0b tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:18.146597 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-70093126-feb0-4cda-b7c7-8c642d02dd0b tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:18.152648 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-70093126-feb0-4cda-b7c7-8c642d02dd0b tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:18.153098 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-70093126-feb0-4cda-b7c7-8c642d02dd0b tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:18.153857 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-70093126-feb0-4cda-b7c7-8c642d02dd0b tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:18.154455 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-70093126-feb0-4cda-b7c7-8c642d02dd0b tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:18.187790 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-70093126-feb0-4cda-b7c7-8c642d02dd0b tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:18.188332 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-70093126-feb0-4cda-b7c7-8c642d02dd0b tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:18.188851 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.objects.instance [None req-70093126-feb0-4cda-b7c7-8c642d02dd0b tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lazy-loading 'fault' on Instance uuid 89a0e254-8280-4e56-80e6-525cca5dcac3 {{(pid=134666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:46:18.231666 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-70093126-feb0-4cda-b7c7-8c642d02dd0b tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7e1bce062244098888ecb72b11ccd88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2fef8d0cb974f35a741c3090fda97f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:18.240829 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-70093126-feb0-4cda-b7c7-8c642d02dd0b tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 200 len: 1224 microversion: 2.1 time: 0.098632 Jun 23 13:46:18.242285 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 437/889] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:18 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:18.647038 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-7b88f165-2850-4fd5-a79f-048db9ede694 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:18.647644 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-7b88f165-2850-4fd5-a79f-048db9ede694 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 7840b5d2-52e9-48db-95ba-af0fb4a5cb52] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:18.655328 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7b88f165-2850-4fd5-a79f-048db9ede694 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:18.655795 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7b88f165-2850-4fd5-a79f-048db9ede694 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:18.656554 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7b88f165-2850-4fd5-a79f-048db9ede694 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:18.656982 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7b88f165-2850-4fd5-a79f-048db9ede694 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:18.671380 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.wsgi [None req-7b88f165-2850-4fd5-a79f-048db9ede694 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] HTTP exception thrown: Instance 7840b5d2-52e9-48db-95ba-af0fb4a5cb52 could not be found. Jun 23 13:46:18.673046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-7b88f165-2850-4fd5-a79f-048db9ede694 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Request method failure captured: Jun 23 13:46:18.673046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: DELETE /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52 HTTP/1.1 Jun 23 13:46:18.673046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:46:18.673046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:46:18.673046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:46:18.673046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 0 Jun 23 13:46:18.673046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:46:18.673046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:46:18.673046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:46:18.673046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:46:18.673046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitG0I_HZU131M8J85RvEQOmj8LgA_2WxO2JHaCALyqdLluOOVQseCnN3b49kmuLUwl7kgpYu_nyCOuFs2D4nvXDzPB-BFMJHg1SH6Biig2M0dk2RuXu07iB9rawZfYchoQTmmnBEWqWi0vz9e6Q6R4kGGzJ8cvnvjbn-HCeyXQcr5f7s Jun 23 13:46:18.673046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:46:18.673046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:46:18.673046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:46:18.673046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:46:18.673046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:46:18.673046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:46:18.673046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: 9298bf4635e84993b086309715cc7cbe Jun 23 13:46:18.673046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:46:18.673046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:46:18.673046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:46:18.674591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9298bf4635e84993b086309715cc7cbe", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:46:18.674591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:46:18.674591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: 9298bf4635e84993b086309715cc7cbe Jun 23 13:46:18.674591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:46:18.674591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-AttachVolumeNegativeTest-1741631114-project Jun 23 13:46:18.674591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:46:18.674591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:46:18.674591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: 007ce9b8109343e0914efe94c6aa6a89 Jun 23 13:46:18.674591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-AttachVolumeNegativeTest-1741631114-project Jun 23 13:46:18.674591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: > Jun 23 13:46:18.674591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Instance 7840b5d2-52e9-48db-95ba-af0fb4a5cb52 could not be found. Jun 23 13:46:18.674591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'id': '7840b5d2-52e9-48db-95ba-af0fb4a5cb52'} Jun 23 13:46:18.675368 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:46:18.675368 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:18.675368 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:46:18.675368 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:46:18.675368 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:46:18.675368 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:46:18.675368 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:46:18.675368 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:46:18.675368 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:46:18.675368 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:46:18.675368 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7840b5d2-52e9-48db-95ba-af0fb4a5cb52 could not be found. Jun 23 13:46:18.675368 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:18.675368 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:18.675368 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:18.675368 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:18.675368 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:18.675368 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:18.675368 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:46:18.675368 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:46:18.675368 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:46:18.676614 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:46:18.676614 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 13:46:18.676614 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 13:46:18.676614 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 13:46:18.676614 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 13:46:18.676614 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:46:18.676614 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:46:18.676614 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:46:18.676614 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:46:18.676614 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7840b5d2-52e9-48db-95ba-af0fb4a5cb52 could not be found. Jun 23 13:46:18.676614 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:18.676614 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:18.676614 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:18.676614 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:18.676614 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:18.676614 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:18.676614 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:46:18.676614 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:46:18.676614 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7840b5d2-52e9-48db-95ba-af0fb4a5cb52 could not be found. Jun 23 13:46:18.676614 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:18.678159 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-7b88f165-2850-4fd5-a79f-048db9ede694 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Returning 404 to user: Instance 7840b5d2-52e9-48db-95ba-af0fb4a5cb52 could not be found. {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:46:18.678159 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-7b88f165-2850-4fd5-a79f-048db9ede694 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52" status: 404 len: 111 microversion: 2.1 time: 0.032100 Jun 23 13:46:18.678159 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 453/890] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Jun 23 13:46:18 2022] DELETE /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:46:18.683325 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-1e1c2ee0-bd72-460f-8326-bb06018323ff tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:18.683961 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-1e1c2ee0-bd72-460f-8326-bb06018323ff tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 7840b5d2-52e9-48db-95ba-af0fb4a5cb52] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:18.690591 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1e1c2ee0-bd72-460f-8326-bb06018323ff tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:18.691035 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1e1c2ee0-bd72-460f-8326-bb06018323ff tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:18.691810 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1e1c2ee0-bd72-460f-8326-bb06018323ff tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:18.692239 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1e1c2ee0-bd72-460f-8326-bb06018323ff tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:18.706253 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.wsgi [None req-1e1c2ee0-bd72-460f-8326-bb06018323ff tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] HTTP exception thrown: Instance 7840b5d2-52e9-48db-95ba-af0fb4a5cb52 could not be found. Jun 23 13:46:18.708153 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-1e1c2ee0-bd72-460f-8326-bb06018323ff tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Request method failure captured: Jun 23 13:46:18.708153 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: request: GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52 HTTP/1.1 Jun 23 13:46:18.708153 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept: application/json Jun 23 13:46:18.708153 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept-Encoding: identity Jun 23 13:46:18.708153 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Connection: close Jun 23 13:46:18.708153 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Length: 0 Jun 23 13:46:18.708153 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Type: application/json Jun 23 13:46:18.708153 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Host: 10.222.0.26 Jun 23 13:46:18.708153 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Openstack-System-Scope: None Jun 23 13:46:18.708153 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: User-Agent: python-urllib3/1.26.9 Jun 23 13:46:18.708153 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Auth-Token: gAAAAABitG0I_HZU131M8J85RvEQOmj8LgA_2WxO2JHaCALyqdLluOOVQseCnN3b49kmuLUwl7kgpYu_nyCOuFs2D4nvXDzPB-BFMJHg1SH6Biig2M0dk2RuXu07iB9rawZfYchoQTmmnBEWqWi0vz9e6Q6R4kGGzJ8cvnvjbn-HCeyXQcr5f7s Jun 23 13:46:18.708153 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Id: None Jun 23 13:46:18.708153 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Name: None Jun 23 13:46:18.708153 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Identity-Status: Confirmed Jun 23 13:46:18.708153 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Is-Admin-Project: True Jun 23 13:46:18.708153 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Id: default Jun 23 13:46:18.708153 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Name: Default Jun 23 13:46:18.708153 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Id: 9298bf4635e84993b086309715cc7cbe Jun 23 13:46:18.708153 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Name: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:46:18.708153 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Role: member,reader Jun 23 13:46:18.708153 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Roles: member,reader Jun 23 13:46:18.709733 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9298bf4635e84993b086309715cc7cbe", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:46:18.709733 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:46:18.709733 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Id: 9298bf4635e84993b086309715cc7cbe Jun 23 13:46:18.709733 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:46:18.709733 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User: tempest-AttachVolumeNegativeTest-1741631114-project Jun 23 13:46:18.709733 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Id: default Jun 23 13:46:18.709733 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Name: Default Jun 23 13:46:18.709733 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Id: 007ce9b8109343e0914efe94c6aa6a89 Jun 23 13:46:18.709733 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Name: tempest-AttachVolumeNegativeTest-1741631114-project Jun 23 13:46:18.709733 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: method: > Jun 23 13:46:18.709733 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: exception: Instance 7840b5d2-52e9-48db-95ba-af0fb4a5cb52 could not be found. Jun 23 13:46:18.709733 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: action_args: {'id': '7840b5d2-52e9-48db-95ba-af0fb4a5cb52'} Jun 23 13:46:18.710607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:46:18.710607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:18.710607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:46:18.710607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:46:18.710607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:46:18.710607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:46:18.710607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:46:18.710607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:46:18.710607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:46:18.710607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:46:18.710607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7840b5d2-52e9-48db-95ba-af0fb4a5cb52 could not be found. Jun 23 13:46:18.710607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:18.710607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:18.710607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:18.710607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:18.710607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:18.710607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:18.710607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:46:18.710607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:46:18.710607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:46:18.712127 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:46:18.712127 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:46:18.712127 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:46:18.712127 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:46:18.712127 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:46:18.712127 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:46:18.712127 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:46:18.712127 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7840b5d2-52e9-48db-95ba-af0fb4a5cb52 could not be found. Jun 23 13:46:18.712127 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:18.712127 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:18.712127 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:18.712127 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:18.712127 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:18.712127 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:18.712127 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:46:18.712127 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:46:18.712127 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7840b5d2-52e9-48db-95ba-af0fb4a5cb52 could not be found. Jun 23 13:46:18.712127 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:18.713492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-1e1c2ee0-bd72-460f-8326-bb06018323ff tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Returning 404 to user: Instance 7840b5d2-52e9-48db-95ba-af0fb4a5cb52 could not be found. {{(pid=134666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:46:18.713492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-1e1c2ee0-bd72-460f-8326-bb06018323ff tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52" status: 404 len: 111 microversion: 2.1 time: 0.030362 Jun 23 13:46:18.713492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 438/891] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:18 2022] GET /compute/v2.1/servers/7840b5d2-52e9-48db-95ba-af0fb4a5cb52 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:46:18.855816 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-fba7d297-5971-4731-b1da-bd210e165f01 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:18.856506 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-fba7d297-5971-4731-b1da-bd210e165f01 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:18.863006 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fba7d297-5971-4731-b1da-bd210e165f01 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:18.863475 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fba7d297-5971-4731-b1da-bd210e165f01 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:18.864265 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fba7d297-5971-4731-b1da-bd210e165f01 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:18.864710 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fba7d297-5971-4731-b1da-bd210e165f01 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:18.953275 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c855dd69-7655-4f31-84bc-f67c870bd31a tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:18.954090 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-c855dd69-7655-4f31-84bc-f67c870bd31a tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] [instance: 75191b56-043b-4024-81a1-d0b1b33391ee] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:18.960974 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c855dd69-7655-4f31-84bc-f67c870bd31a tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:18.961693 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c855dd69-7655-4f31-84bc-f67c870bd31a tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:18.962447 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c855dd69-7655-4f31-84bc-f67c870bd31a tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:18.962888 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c855dd69-7655-4f31-84bc-f67c870bd31a tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:18.979307 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.wsgi [None req-c855dd69-7655-4f31-84bc-f67c870bd31a tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] HTTP exception thrown: Instance 75191b56-043b-4024-81a1-d0b1b33391ee could not be found. Jun 23 13:46:18.980889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c855dd69-7655-4f31-84bc-f67c870bd31a tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Request method failure captured: Jun 23 13:46:18.980889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: request: GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee HTTP/1.1 Jun 23 13:46:18.980889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept: application/json Jun 23 13:46:18.980889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept-Encoding: identity Jun 23 13:46:18.980889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Connection: close Jun 23 13:46:18.980889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Length: 0 Jun 23 13:46:18.980889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Type: application/json Jun 23 13:46:18.980889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Host: 10.222.0.26 Jun 23 13:46:18.980889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Openstack-System-Scope: None Jun 23 13:46:18.980889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: User-Agent: python-urllib3/1.26.9 Jun 23 13:46:18.980889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Auth-Token: gAAAAABitG6X5C0xN5FVVr-nOztksbjNeF9Rv_yQRR4Mcb6fGL4940J50S7hmpk2mfBORPwb68T0SdPlGqU497QCDtaZDYwMMb4KuYmuEKUaChkmkQAfESfG2mEw6F6VzUHl5qSAOVy86nF0M3G2JhWNtWYDpUKCOR3JYx7Y7XOAfIdI1XKnD7Y Jun 23 13:46:18.980889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Id: None Jun 23 13:46:18.980889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Name: None Jun 23 13:46:18.980889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Identity-Status: Confirmed Jun 23 13:46:18.980889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Is-Admin-Project: True Jun 23 13:46:18.980889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Id: default Jun 23 13:46:18.980889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Name: Default Jun 23 13:46:18.980889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Id: 2bc4a7159fa34affae55ebdbb866f88b Jun 23 13:46:18.980889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Name: tempest-VolumesNegativeTest-892365819 Jun 23 13:46:18.980889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Role: member,reader Jun 23 13:46:18.980889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Roles: member,reader Jun 23 13:46:18.982426 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2bc4a7159fa34affae55ebdbb866f88b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2bc4a7159fa34affae55ebdbb866f88b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2bc4a7159fa34affae55ebdbb866f88b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2bc4a7159fa34affae55ebdbb866f88b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:46:18.982426 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant: tempest-VolumesNegativeTest-892365819 Jun 23 13:46:18.982426 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Id: 2bc4a7159fa34affae55ebdbb866f88b Jun 23 13:46:18.982426 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Name: tempest-VolumesNegativeTest-892365819 Jun 23 13:46:18.982426 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User: tempest-VolumesNegativeTest-892365819-project Jun 23 13:46:18.982426 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Id: default Jun 23 13:46:18.982426 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Name: Default Jun 23 13:46:18.982426 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Id: 7cd2882baad040019be3aa1e554c5905 Jun 23 13:46:18.982426 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Name: tempest-VolumesNegativeTest-892365819-project Jun 23 13:46:18.982426 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: method: > Jun 23 13:46:18.982426 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: exception: Instance 75191b56-043b-4024-81a1-d0b1b33391ee could not be found. Jun 23 13:46:18.982426 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: action_args: {'id': '75191b56-043b-4024-81a1-d0b1b33391ee'} Jun 23 13:46:18.983315 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:46:18.983315 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:18.983315 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:46:18.983315 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:46:18.983315 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:46:18.983315 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:46:18.983315 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:46:18.983315 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:46:18.983315 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:46:18.983315 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:46:18.983315 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75191b56-043b-4024-81a1-d0b1b33391ee could not be found. Jun 23 13:46:18.983315 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:18.983315 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:18.983315 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:18.983315 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:18.983315 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:18.983315 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:18.983315 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:46:18.983315 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:46:18.983315 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:46:18.984607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:46:18.984607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:46:18.984607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:46:18.984607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:46:18.984607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:46:18.984607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:46:18.984607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:46:18.984607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75191b56-043b-4024-81a1-d0b1b33391ee could not be found. Jun 23 13:46:18.984607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:18.984607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:18.984607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:18.984607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:18.984607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:18.984607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:18.984607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:46:18.984607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:46:18.984607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75191b56-043b-4024-81a1-d0b1b33391ee could not be found. Jun 23 13:46:18.984607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:18.985703 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c855dd69-7655-4f31-84bc-f67c870bd31a tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] Returning 404 to user: Instance 75191b56-043b-4024-81a1-d0b1b33391ee could not be found. {{(pid=134666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:46:18.985703 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-c855dd69-7655-4f31-84bc-f67c870bd31a tempest-VolumesNegativeTest-892365819 tempest-VolumesNegativeTest-892365819-project] 10.222.0.26 "GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee" status: 404 len: 111 microversion: 2.1 time: 0.033099 Jun 23 13:46:18.985703 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 439/892] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:18 2022] GET /compute/v2.1/servers/75191b56-043b-4024-81a1-d0b1b33391ee => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 13:46:19.008896 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-fba7d297-5971-4731-b1da-bd210e165f01 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:19.016962 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-fba7d297-5971-4731-b1da-bd210e165f01 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59" status: 200 len: 1263 microversion: 2.1 time: 0.166602 Jun 23 13:46:19.017719 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 454/893] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:18 2022] GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 => generated 1263 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:19.258772 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-68bca055-167f-4db6-8a49-f64acb7da0fc tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:19.259106 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-68bca055-167f-4db6-8a49-f64acb7da0fc tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] [instance: 89a0e254-8280-4e56-80e6-525cca5dcac3] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:19.265515 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-68bca055-167f-4db6-8a49-f64acb7da0fc tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:19.265972 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-68bca055-167f-4db6-8a49-f64acb7da0fc tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:19.266743 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-68bca055-167f-4db6-8a49-f64acb7da0fc tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:19.266967 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-6455a68e-0dda-4eed-a50a-5e2ef8692fb3 req-fe230f32-f520-4ad7-bc61-7b096ffc65f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75191b56-043b-4024-81a1-d0b1b33391ee", "name": "network-vif-deleted", "tag": "329b604d-8767-4336-bdb4-15ab223f1fd5"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:46:19.267219 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-68bca055-167f-4db6-8a49-f64acb7da0fc tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:19.277963 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-6455a68e-0dda-4eed-a50a-5e2ef8692fb3 req-fe230f32-f520-4ad7-bc61-7b096ffc65f9 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:19.278758 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-6455a68e-0dda-4eed-a50a-5e2ef8692fb3 req-fe230f32-f520-4ad7-bc61-7b096ffc65f9 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:19.281547 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.wsgi [None req-68bca055-167f-4db6-8a49-f64acb7da0fc tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] HTTP exception thrown: Instance 89a0e254-8280-4e56-80e6-525cca5dcac3 could not be found. Jun 23 13:46:19.283097 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-68bca055-167f-4db6-8a49-f64acb7da0fc tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Request method failure captured: Jun 23 13:46:19.283097 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: request: GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 HTTP/1.1 Jun 23 13:46:19.283097 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept: application/json Jun 23 13:46:19.283097 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept-Encoding: identity Jun 23 13:46:19.283097 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Connection: close Jun 23 13:46:19.283097 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Length: 0 Jun 23 13:46:19.283097 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Type: application/json Jun 23 13:46:19.283097 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Host: 10.222.0.26 Jun 23 13:46:19.283097 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Openstack-System-Scope: None Jun 23 13:46:19.283097 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: User-Agent: python-urllib3/1.26.9 Jun 23 13:46:19.283097 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Auth-Token: gAAAAABitG1DSwAE8oa2v6r4KC3vFIofi8zjSbGgQITWVGxjQth2WJ-oifJhXjmoo1OY3qW9Kj-qLNQpdfNYW7dkRaO1TVktIn0xC7TRO71lEicWACKZoItSZFJY-iHvKwmHDQEMKhOwVa7g68iHZ_y8CoufEznJCvi73blduhR1aIMwcySbBEk Jun 23 13:46:19.283097 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Id: None Jun 23 13:46:19.283097 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Name: None Jun 23 13:46:19.283097 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Identity-Status: Confirmed Jun 23 13:46:19.283097 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Is-Admin-Project: True Jun 23 13:46:19.283097 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Id: default Jun 23 13:46:19.283097 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Name: Default Jun 23 13:46:19.283097 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Id: b2fef8d0cb974f35a741c3090fda97f1 Jun 23 13:46:19.283097 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Name: tempest-TestShelveInstance-622091917 Jun 23 13:46:19.283097 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Role: member,reader Jun 23 13:46:19.283097 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Roles: member,reader Jun 23 13:46:19.284452 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b2fef8d0cb974f35a741c3090fda97f1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b2fef8d0cb974f35a741c3090fda97f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b2fef8d0cb974f35a741c3090fda97f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b2fef8d0cb974f35a741c3090fda97f1", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:46:19.284452 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant: tempest-TestShelveInstance-622091917 Jun 23 13:46:19.284452 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Id: b2fef8d0cb974f35a741c3090fda97f1 Jun 23 13:46:19.284452 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Name: tempest-TestShelveInstance-622091917 Jun 23 13:46:19.284452 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User: tempest-TestShelveInstance-622091917-project Jun 23 13:46:19.284452 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Id: default Jun 23 13:46:19.284452 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Name: Default Jun 23 13:46:19.284452 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Id: e7e1bce062244098888ecb72b11ccd88 Jun 23 13:46:19.284452 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Name: tempest-TestShelveInstance-622091917-project Jun 23 13:46:19.284452 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: method: > Jun 23 13:46:19.284452 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: exception: Instance 89a0e254-8280-4e56-80e6-525cca5dcac3 could not be found. Jun 23 13:46:19.284452 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: action_args: {'id': '89a0e254-8280-4e56-80e6-525cca5dcac3'} Jun 23 13:46:19.285217 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:46:19.285217 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:19.285217 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:46:19.285217 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:46:19.285217 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:46:19.285217 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:46:19.285217 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:46:19.285217 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:46:19.285217 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:46:19.285217 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:46:19.285217 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89a0e254-8280-4e56-80e6-525cca5dcac3 could not be found. Jun 23 13:46:19.285217 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:19.285217 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:19.285217 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:19.285217 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:19.285217 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:19.285217 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:19.285217 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:46:19.285217 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:46:19.285217 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:46:19.286390 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:46:19.286390 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:46:19.286390 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:46:19.286390 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:46:19.286390 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:46:19.286390 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:46:19.286390 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:46:19.286390 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89a0e254-8280-4e56-80e6-525cca5dcac3 could not be found. Jun 23 13:46:19.286390 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:19.286390 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:19.286390 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:19.286390 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:19.286390 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:19.286390 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:19.286390 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:46:19.286390 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:46:19.286390 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89a0e254-8280-4e56-80e6-525cca5dcac3 could not be found. Jun 23 13:46:19.286390 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:19.287512 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-68bca055-167f-4db6-8a49-f64acb7da0fc tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Returning 404 to user: Instance 89a0e254-8280-4e56-80e6-525cca5dcac3 could not be found. {{(pid=134666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:46:19.287512 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-68bca055-167f-4db6-8a49-f64acb7da0fc tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3" status: 404 len: 111 microversion: 2.1 time: 0.030053 Jun 23 13:46:19.287512 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 440/894] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:19 2022] GET /compute/v2.1/servers/89a0e254-8280-4e56-80e6-525cca5dcac3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:46:19.298383 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-6455a68e-0dda-4eed-a50a-5e2ef8692fb3 req-fe230f32-f520-4ad7-bc61-7b096ffc65f9 service nova] Creating event network-vif-deleted:329b604d-8767-4336-bdb4-15ab223f1fd5 for instance 75191b56-043b-4024-81a1-d0b1b33391ee on hv-cinder-81558 Jun 23 13:46:19.303784 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-6455a68e-0dda-4eed-a50a-5e2ef8692fb3 req-fe230f32-f520-4ad7-bc61-7b096ffc65f9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040299 Jun 23 13:46:19.304421 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 455/895] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:46:19.473192 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-8f4b109a-3e42-4a02-8838-2f8233397c47 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] Calling method '.version_select at 0x7fd77237ef70>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:19.500533 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-8f4b109a-3e42-4a02-8838-2f8233397c47 tempest-TestShelveInstance-622091917 tempest-TestShelveInstance-622091917-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-150071967" status: 202 len: 0 microversion: 2.1 time: 0.031026 Jun 23 13:46:19.505149 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 441/896] 10.222.0.26 () {58 vars in 1250 bytes} [Thu Jun 23 13:46:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-150071967 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 13:46:19.862355 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-0f5f2a63-94e4-4817-9d3a-62ccfa77eead tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:19.863672 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-0f5f2a63-94e4-4817-9d3a-62ccfa77eead tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:19.871200 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0f5f2a63-94e4-4817-9d3a-62ccfa77eead tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:19.872060 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0f5f2a63-94e4-4817-9d3a-62ccfa77eead tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:19.873200 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0f5f2a63-94e4-4817-9d3a-62ccfa77eead tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:19.873771 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0f5f2a63-94e4-4817-9d3a-62ccfa77eead tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:19.889412 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.wsgi [None req-0f5f2a63-94e4-4817-9d3a-62ccfa77eead tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] HTTP exception thrown: Instance 2d2cbd7f-a2a8-4a8e-beea-655a691d1528 could not be found. Jun 23 13:46:19.891144 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-0f5f2a63-94e4-4817-9d3a-62ccfa77eead tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Request method failure captured: Jun 23 13:46:19.891144 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: DELETE /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528 HTTP/1.1 Jun 23 13:46:19.891144 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:46:19.891144 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:46:19.891144 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:46:19.891144 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 0 Jun 23 13:46:19.891144 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:46:19.891144 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:46:19.891144 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:46:19.891144 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:46:19.891144 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitG0I_HZU131M8J85RvEQOmj8LgA_2WxO2JHaCALyqdLluOOVQseCnN3b49kmuLUwl7kgpYu_nyCOuFs2D4nvXDzPB-BFMJHg1SH6Biig2M0dk2RuXu07iB9rawZfYchoQTmmnBEWqWi0vz9e6Q6R4kGGzJ8cvnvjbn-HCeyXQcr5f7s Jun 23 13:46:19.891144 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:46:19.891144 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:46:19.891144 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:46:19.891144 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:46:19.891144 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:46:19.891144 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:46:19.891144 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: 9298bf4635e84993b086309715cc7cbe Jun 23 13:46:19.891144 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:46:19.891144 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:46:19.891144 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:46:19.892758 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9298bf4635e84993b086309715cc7cbe", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:46:19.892758 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:46:19.892758 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: 9298bf4635e84993b086309715cc7cbe Jun 23 13:46:19.892758 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:46:19.892758 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-AttachVolumeNegativeTest-1741631114-project Jun 23 13:46:19.892758 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:46:19.892758 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:46:19.892758 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: 007ce9b8109343e0914efe94c6aa6a89 Jun 23 13:46:19.892758 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-AttachVolumeNegativeTest-1741631114-project Jun 23 13:46:19.892758 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: > Jun 23 13:46:19.892758 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Instance 2d2cbd7f-a2a8-4a8e-beea-655a691d1528 could not be found. Jun 23 13:46:19.892758 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'id': '2d2cbd7f-a2a8-4a8e-beea-655a691d1528'} Jun 23 13:46:19.893984 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:46:19.893984 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:19.893984 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:46:19.893984 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:46:19.893984 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:46:19.893984 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:46:19.893984 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:46:19.893984 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:46:19.893984 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:46:19.893984 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:46:19.893984 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d2cbd7f-a2a8-4a8e-beea-655a691d1528 could not be found. Jun 23 13:46:19.893984 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:19.893984 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:19.893984 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:19.893984 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:19.893984 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:19.893984 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:19.893984 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:46:19.893984 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:46:19.893984 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:46:19.895601 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:46:19.895601 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 13:46:19.895601 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 13:46:19.895601 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 13:46:19.895601 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 13:46:19.895601 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:46:19.895601 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:46:19.895601 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:46:19.895601 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:46:19.895601 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d2cbd7f-a2a8-4a8e-beea-655a691d1528 could not be found. Jun 23 13:46:19.895601 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:19.895601 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:19.895601 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:19.895601 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:19.895601 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:19.895601 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:19.895601 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:46:19.895601 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:46:19.895601 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d2cbd7f-a2a8-4a8e-beea-655a691d1528 could not be found. Jun 23 13:46:19.895601 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:19.898028 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-0f5f2a63-94e4-4817-9d3a-62ccfa77eead tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Returning 404 to user: Instance 2d2cbd7f-a2a8-4a8e-beea-655a691d1528 could not be found. {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:46:19.898986 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-0f5f2a63-94e4-4817-9d3a-62ccfa77eead tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528" status: 404 len: 111 microversion: 2.1 time: 0.041717 Jun 23 13:46:19.899577 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 456/897] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Jun 23 13:46:19 2022] DELETE /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:46:19.909853 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-5e79e348-82ab-40aa-b4f6-0f4124f84624 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:19.910466 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-5e79e348-82ab-40aa-b4f6-0f4124f84624 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 2d2cbd7f-a2a8-4a8e-beea-655a691d1528] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:19.917137 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5e79e348-82ab-40aa-b4f6-0f4124f84624 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:19.917589 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5e79e348-82ab-40aa-b4f6-0f4124f84624 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:19.918368 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5e79e348-82ab-40aa-b4f6-0f4124f84624 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:19.918973 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5e79e348-82ab-40aa-b4f6-0f4124f84624 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:19.934859 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.wsgi [None req-5e79e348-82ab-40aa-b4f6-0f4124f84624 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] HTTP exception thrown: Instance 2d2cbd7f-a2a8-4a8e-beea-655a691d1528 could not be found. Jun 23 13:46:19.936875 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-5e79e348-82ab-40aa-b4f6-0f4124f84624 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Request method failure captured: Jun 23 13:46:19.936875 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: request: GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528 HTTP/1.1 Jun 23 13:46:19.936875 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept: application/json Jun 23 13:46:19.936875 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept-Encoding: identity Jun 23 13:46:19.936875 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Connection: close Jun 23 13:46:19.936875 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Length: 0 Jun 23 13:46:19.936875 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Type: application/json Jun 23 13:46:19.936875 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Host: 10.222.0.26 Jun 23 13:46:19.936875 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Openstack-System-Scope: None Jun 23 13:46:19.936875 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: User-Agent: python-urllib3/1.26.9 Jun 23 13:46:19.936875 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Auth-Token: gAAAAABitG0I_HZU131M8J85RvEQOmj8LgA_2WxO2JHaCALyqdLluOOVQseCnN3b49kmuLUwl7kgpYu_nyCOuFs2D4nvXDzPB-BFMJHg1SH6Biig2M0dk2RuXu07iB9rawZfYchoQTmmnBEWqWi0vz9e6Q6R4kGGzJ8cvnvjbn-HCeyXQcr5f7s Jun 23 13:46:19.936875 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Id: None Jun 23 13:46:19.936875 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Name: None Jun 23 13:46:19.936875 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Identity-Status: Confirmed Jun 23 13:46:19.936875 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Is-Admin-Project: True Jun 23 13:46:19.936875 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Id: default Jun 23 13:46:19.936875 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Name: Default Jun 23 13:46:19.936875 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Id: 9298bf4635e84993b086309715cc7cbe Jun 23 13:46:19.936875 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Name: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:46:19.936875 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Role: member,reader Jun 23 13:46:19.936875 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Roles: member,reader Jun 23 13:46:19.938464 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9298bf4635e84993b086309715cc7cbe", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:46:19.938464 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:46:19.938464 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Id: 9298bf4635e84993b086309715cc7cbe Jun 23 13:46:19.938464 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:46:19.938464 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User: tempest-AttachVolumeNegativeTest-1741631114-project Jun 23 13:46:19.938464 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Id: default Jun 23 13:46:19.938464 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Name: Default Jun 23 13:46:19.938464 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Id: 007ce9b8109343e0914efe94c6aa6a89 Jun 23 13:46:19.938464 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Name: tempest-AttachVolumeNegativeTest-1741631114-project Jun 23 13:46:19.938464 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: method: > Jun 23 13:46:19.938464 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: exception: Instance 2d2cbd7f-a2a8-4a8e-beea-655a691d1528 could not be found. Jun 23 13:46:19.938464 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: action_args: {'id': '2d2cbd7f-a2a8-4a8e-beea-655a691d1528'} Jun 23 13:46:19.939353 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:46:19.939353 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:19.939353 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:46:19.939353 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:46:19.939353 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:46:19.939353 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:46:19.939353 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:46:19.939353 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:46:19.939353 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:46:19.939353 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:46:19.939353 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d2cbd7f-a2a8-4a8e-beea-655a691d1528 could not be found. Jun 23 13:46:19.939353 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:19.939353 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:19.939353 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:19.939353 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:19.939353 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:19.939353 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:19.939353 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:46:19.939353 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:46:19.939353 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:46:19.940796 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:46:19.940796 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:46:19.940796 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:46:19.940796 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:46:19.940796 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:46:19.940796 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:46:19.940796 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:46:19.940796 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d2cbd7f-a2a8-4a8e-beea-655a691d1528 could not be found. Jun 23 13:46:19.940796 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:19.940796 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:19.940796 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:19.940796 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:19.940796 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:19.940796 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:19.940796 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:46:19.940796 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:46:19.940796 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d2cbd7f-a2a8-4a8e-beea-655a691d1528 could not be found. Jun 23 13:46:19.940796 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:19.941897 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-5e79e348-82ab-40aa-b4f6-0f4124f84624 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Returning 404 to user: Instance 2d2cbd7f-a2a8-4a8e-beea-655a691d1528 could not be found. {{(pid=134666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:46:19.941897 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-5e79e348-82ab-40aa-b4f6-0f4124f84624 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528" status: 404 len: 111 microversion: 2.1 time: 0.033992 Jun 23 13:46:19.941897 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 442/898] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:19 2022] GET /compute/v2.1/servers/2d2cbd7f-a2a8-4a8e-beea-655a691d1528 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:46:19.948067 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-b8915ca5-9dd9-4303-b73c-23e28410014b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:19.948594 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-b8915ca5-9dd9-4303-b73c-23e28410014b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:19.955010 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b8915ca5-9dd9-4303-b73c-23e28410014b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:19.955442 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b8915ca5-9dd9-4303-b73c-23e28410014b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:19.956529 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b8915ca5-9dd9-4303-b73c-23e28410014b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:19.957140 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b8915ca5-9dd9-4303-b73c-23e28410014b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:19.971567 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.wsgi [None req-b8915ca5-9dd9-4303-b73c-23e28410014b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] HTTP exception thrown: Instance 0417cd02-d58c-4bd7-8847-6b817258fc3d could not be found. Jun 23 13:46:19.974417 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-b8915ca5-9dd9-4303-b73c-23e28410014b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Request method failure captured: Jun 23 13:46:19.974417 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: DELETE /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d HTTP/1.1 Jun 23 13:46:19.974417 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:46:19.974417 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:46:19.974417 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:46:19.974417 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 0 Jun 23 13:46:19.974417 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:46:19.974417 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:46:19.974417 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:46:19.974417 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:46:19.974417 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitG0I_HZU131M8J85RvEQOmj8LgA_2WxO2JHaCALyqdLluOOVQseCnN3b49kmuLUwl7kgpYu_nyCOuFs2D4nvXDzPB-BFMJHg1SH6Biig2M0dk2RuXu07iB9rawZfYchoQTmmnBEWqWi0vz9e6Q6R4kGGzJ8cvnvjbn-HCeyXQcr5f7s Jun 23 13:46:19.974417 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:46:19.974417 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:46:19.974417 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:46:19.974417 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:46:19.974417 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:46:19.974417 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:46:19.974417 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: 9298bf4635e84993b086309715cc7cbe Jun 23 13:46:19.974417 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:46:19.974417 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:46:19.974417 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:46:19.976393 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9298bf4635e84993b086309715cc7cbe", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:46:19.976393 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:46:19.976393 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: 9298bf4635e84993b086309715cc7cbe Jun 23 13:46:19.976393 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:46:19.976393 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-AttachVolumeNegativeTest-1741631114-project Jun 23 13:46:19.976393 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:46:19.976393 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:46:19.976393 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: 007ce9b8109343e0914efe94c6aa6a89 Jun 23 13:46:19.976393 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-AttachVolumeNegativeTest-1741631114-project Jun 23 13:46:19.976393 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: > Jun 23 13:46:19.976393 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Instance 0417cd02-d58c-4bd7-8847-6b817258fc3d could not be found. Jun 23 13:46:19.976393 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'id': '0417cd02-d58c-4bd7-8847-6b817258fc3d'} Jun 23 13:46:19.977406 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:46:19.977406 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:19.977406 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:46:19.977406 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:46:19.977406 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:46:19.977406 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:46:19.977406 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:46:19.977406 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:46:19.977406 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:46:19.977406 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:46:19.977406 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0417cd02-d58c-4bd7-8847-6b817258fc3d could not be found. Jun 23 13:46:19.977406 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:19.977406 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:19.977406 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:19.977406 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:19.977406 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:19.977406 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:19.977406 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:46:19.977406 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:46:19.977406 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:46:19.978703 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:46:19.978703 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 13:46:19.978703 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 13:46:19.978703 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 13:46:19.978703 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 13:46:19.978703 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:46:19.978703 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:46:19.978703 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:46:19.978703 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:46:19.978703 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0417cd02-d58c-4bd7-8847-6b817258fc3d could not be found. Jun 23 13:46:19.978703 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:19.978703 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:19.978703 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:19.978703 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:19.978703 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:19.978703 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:19.978703 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:46:19.978703 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:46:19.978703 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0417cd02-d58c-4bd7-8847-6b817258fc3d could not be found. Jun 23 13:46:19.978703 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:19.979960 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-b8915ca5-9dd9-4303-b73c-23e28410014b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Returning 404 to user: Instance 0417cd02-d58c-4bd7-8847-6b817258fc3d could not be found. {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:46:19.979960 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-b8915ca5-9dd9-4303-b73c-23e28410014b tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 404 len: 111 microversion: 2.1 time: 0.031919 Jun 23 13:46:19.979960 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 457/899] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Jun 23 13:46:19 2022] DELETE /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:46:19.985320 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-9a36dd4f-cc55-4957-b0b7-ca9530fa354d tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:19.986239 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-9a36dd4f-cc55-4957-b0b7-ca9530fa354d tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: 0417cd02-d58c-4bd7-8847-6b817258fc3d] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:19.993193 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9a36dd4f-cc55-4957-b0b7-ca9530fa354d tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:19.993829 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9a36dd4f-cc55-4957-b0b7-ca9530fa354d tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:19.994949 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9a36dd4f-cc55-4957-b0b7-ca9530fa354d tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:19.995669 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9a36dd4f-cc55-4957-b0b7-ca9530fa354d tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:20.012968 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.wsgi [None req-9a36dd4f-cc55-4957-b0b7-ca9530fa354d tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] HTTP exception thrown: Instance 0417cd02-d58c-4bd7-8847-6b817258fc3d could not be found. Jun 23 13:46:20.014585 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-9a36dd4f-cc55-4957-b0b7-ca9530fa354d tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Request method failure captured: Jun 23 13:46:20.014585 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: request: GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d HTTP/1.1 Jun 23 13:46:20.014585 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept: application/json Jun 23 13:46:20.014585 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept-Encoding: identity Jun 23 13:46:20.014585 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Connection: close Jun 23 13:46:20.014585 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Length: 0 Jun 23 13:46:20.014585 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Type: application/json Jun 23 13:46:20.014585 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Host: 10.222.0.26 Jun 23 13:46:20.014585 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Openstack-System-Scope: None Jun 23 13:46:20.014585 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: User-Agent: python-urllib3/1.26.9 Jun 23 13:46:20.014585 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Auth-Token: gAAAAABitG0I_HZU131M8J85RvEQOmj8LgA_2WxO2JHaCALyqdLluOOVQseCnN3b49kmuLUwl7kgpYu_nyCOuFs2D4nvXDzPB-BFMJHg1SH6Biig2M0dk2RuXu07iB9rawZfYchoQTmmnBEWqWi0vz9e6Q6R4kGGzJ8cvnvjbn-HCeyXQcr5f7s Jun 23 13:46:20.014585 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Id: None Jun 23 13:46:20.014585 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Name: None Jun 23 13:46:20.014585 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Identity-Status: Confirmed Jun 23 13:46:20.014585 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Is-Admin-Project: True Jun 23 13:46:20.014585 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Id: default Jun 23 13:46:20.014585 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Name: Default Jun 23 13:46:20.014585 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Id: 9298bf4635e84993b086309715cc7cbe Jun 23 13:46:20.014585 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Name: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:46:20.014585 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Role: member,reader Jun 23 13:46:20.014585 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Roles: member,reader Jun 23 13:46:20.016197 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9298bf4635e84993b086309715cc7cbe", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:46:20.016197 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:46:20.016197 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Id: 9298bf4635e84993b086309715cc7cbe Jun 23 13:46:20.016197 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:46:20.016197 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User: tempest-AttachVolumeNegativeTest-1741631114-project Jun 23 13:46:20.016197 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Id: default Jun 23 13:46:20.016197 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Name: Default Jun 23 13:46:20.016197 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Id: 007ce9b8109343e0914efe94c6aa6a89 Jun 23 13:46:20.016197 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Name: tempest-AttachVolumeNegativeTest-1741631114-project Jun 23 13:46:20.016197 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: method: > Jun 23 13:46:20.016197 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: exception: Instance 0417cd02-d58c-4bd7-8847-6b817258fc3d could not be found. Jun 23 13:46:20.016197 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: action_args: {'id': '0417cd02-d58c-4bd7-8847-6b817258fc3d'} Jun 23 13:46:20.016925 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:46:20.016925 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:20.016925 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:46:20.016925 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:46:20.016925 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:46:20.016925 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:46:20.016925 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:46:20.016925 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:46:20.016925 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:46:20.016925 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:46:20.016925 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0417cd02-d58c-4bd7-8847-6b817258fc3d could not be found. Jun 23 13:46:20.016925 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:20.016925 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:20.016925 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:20.016925 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:20.016925 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:20.016925 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:20.016925 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:46:20.016925 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:46:20.016925 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:46:20.018134 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:46:20.018134 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:46:20.018134 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:46:20.018134 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:46:20.018134 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:46:20.018134 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:46:20.018134 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:46:20.018134 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0417cd02-d58c-4bd7-8847-6b817258fc3d could not be found. Jun 23 13:46:20.018134 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:20.018134 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:20.018134 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:20.018134 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:20.018134 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:20.018134 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:20.018134 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:46:20.018134 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:46:20.018134 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0417cd02-d58c-4bd7-8847-6b817258fc3d could not be found. Jun 23 13:46:20.018134 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:20.020372 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-9a36dd4f-cc55-4957-b0b7-ca9530fa354d tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Returning 404 to user: Instance 0417cd02-d58c-4bd7-8847-6b817258fc3d could not be found. {{(pid=134666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:46:20.020372 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-9a36dd4f-cc55-4957-b0b7-ca9530fa354d tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d" status: 404 len: 111 microversion: 2.1 time: 0.034851 Jun 23 13:46:20.020372 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 443/900] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:19 2022] GET /compute/v2.1/servers/0417cd02-d58c-4bd7-8847-6b817258fc3d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:46:20.038157 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-06a199ab-cd8a-4b2e-a6df-981420519a34 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:20.040218 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-06a199ab-cd8a-4b2e-a6df-981420519a34 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:20.048523 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-06a199ab-cd8a-4b2e-a6df-981420519a34 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:20.049413 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-06a199ab-cd8a-4b2e-a6df-981420519a34 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:20.050593 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-06a199ab-cd8a-4b2e-a6df-981420519a34 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:20.051475 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-06a199ab-cd8a-4b2e-a6df-981420519a34 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:20.385296 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-06a199ab-cd8a-4b2e-a6df-981420519a34 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:20.393177 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-06a199ab-cd8a-4b2e-a6df-981420519a34 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59" status: 200 len: 1450 microversion: 2.1 time: 0.360281 Jun 23 13:46:20.393835 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 458/901] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:20 2022] GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 => generated 1450 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:20.409586 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c264c06c-711b-479f-baae-e1d3ecc7a00b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:20.410188 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-c264c06c-711b-479f-baae-e1d3ecc7a00b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:20.417269 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c264c06c-711b-479f-baae-e1d3ecc7a00b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:20.417707 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c264c06c-711b-479f-baae-e1d3ecc7a00b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:20.419667 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c264c06c-711b-479f-baae-e1d3ecc7a00b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:20.420781 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c264c06c-711b-479f-baae-e1d3ecc7a00b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:20.862970 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-c264c06c-711b-479f-baae-e1d3ecc7a00b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:20.871228 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-c264c06c-711b-479f-baae-e1d3ecc7a00b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59" status: 200 len: 1450 microversion: 2.1 time: 0.465472 Jun 23 13:46:20.877251 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 444/902] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:20 2022] GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 => generated 1450 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:21.210579 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-c88d1fae-7eb7-44d1-9937-8af4f0cac284 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:21.211105 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-c88d1fae-7eb7-44d1-9937-8af4f0cac284 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:21.218289 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c88d1fae-7eb7-44d1-9937-8af4f0cac284 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:21.220088 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c88d1fae-7eb7-44d1-9937-8af4f0cac284 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:21.223820 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c88d1fae-7eb7-44d1-9937-8af4f0cac284 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:21.224546 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c88d1fae-7eb7-44d1-9937-8af4f0cac284 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:21.244651 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.wsgi [None req-c88d1fae-7eb7-44d1-9937-8af4f0cac284 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] HTTP exception thrown: Instance f8dd165f-4996-4336-a117-cd2a9ba751fa could not be found. Jun 23 13:46:21.246459 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-c88d1fae-7eb7-44d1-9937-8af4f0cac284 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Request method failure captured: Jun 23 13:46:21.246459 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: DELETE /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa HTTP/1.1 Jun 23 13:46:21.246459 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:46:21.246459 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:46:21.246459 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:46:21.246459 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 0 Jun 23 13:46:21.246459 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:46:21.246459 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:46:21.246459 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:46:21.246459 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:46:21.246459 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitG0I_HZU131M8J85RvEQOmj8LgA_2WxO2JHaCALyqdLluOOVQseCnN3b49kmuLUwl7kgpYu_nyCOuFs2D4nvXDzPB-BFMJHg1SH6Biig2M0dk2RuXu07iB9rawZfYchoQTmmnBEWqWi0vz9e6Q6R4kGGzJ8cvnvjbn-HCeyXQcr5f7s Jun 23 13:46:21.246459 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:46:21.246459 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:46:21.246459 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:46:21.246459 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:46:21.246459 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:46:21.246459 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:46:21.246459 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: 9298bf4635e84993b086309715cc7cbe Jun 23 13:46:21.246459 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:46:21.246459 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:46:21.246459 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:46:21.247863 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9298bf4635e84993b086309715cc7cbe", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:46:21.247863 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:46:21.247863 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: 9298bf4635e84993b086309715cc7cbe Jun 23 13:46:21.247863 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:46:21.247863 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-AttachVolumeNegativeTest-1741631114-project Jun 23 13:46:21.247863 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:46:21.247863 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:46:21.247863 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: 007ce9b8109343e0914efe94c6aa6a89 Jun 23 13:46:21.247863 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-AttachVolumeNegativeTest-1741631114-project Jun 23 13:46:21.247863 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: > Jun 23 13:46:21.247863 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Instance f8dd165f-4996-4336-a117-cd2a9ba751fa could not be found. Jun 23 13:46:21.247863 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'id': 'f8dd165f-4996-4336-a117-cd2a9ba751fa'} Jun 23 13:46:21.248591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:46:21.248591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:21.248591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:46:21.248591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:46:21.248591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:46:21.248591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:46:21.248591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:46:21.248591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:46:21.248591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:46:21.248591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:46:21.248591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8dd165f-4996-4336-a117-cd2a9ba751fa could not be found. Jun 23 13:46:21.248591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:21.248591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:21.248591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:21.248591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:21.248591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:21.248591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:21.248591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:46:21.248591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:46:21.248591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:46:21.249778 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:46:21.249778 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 13:46:21.249778 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 13:46:21.249778 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 13:46:21.249778 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 13:46:21.249778 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:46:21.249778 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:46:21.249778 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:46:21.249778 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:46:21.249778 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8dd165f-4996-4336-a117-cd2a9ba751fa could not be found. Jun 23 13:46:21.249778 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:21.249778 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:21.249778 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:21.249778 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:21.249778 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:21.249778 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:21.249778 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:46:21.249778 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:46:21.249778 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8dd165f-4996-4336-a117-cd2a9ba751fa could not be found. Jun 23 13:46:21.249778 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:21.252697 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-c88d1fae-7eb7-44d1-9937-8af4f0cac284 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Returning 404 to user: Instance f8dd165f-4996-4336-a117-cd2a9ba751fa could not be found. {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:46:21.253906 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-c88d1fae-7eb7-44d1-9937-8af4f0cac284 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa" status: 404 len: 111 microversion: 2.1 time: 0.054003 Jun 23 13:46:21.262801 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-fcef2357-dcf4-4a04-accf-b0d6c4443a71 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:21.264108 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-fcef2357-dcf4-4a04-accf-b0d6c4443a71 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] [instance: f8dd165f-4996-4336-a117-cd2a9ba751fa] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:21.268881 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 459/903] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Jun 23 13:46:21 2022] DELETE /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:46:21.271419 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fcef2357-dcf4-4a04-accf-b0d6c4443a71 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:21.272084 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fcef2357-dcf4-4a04-accf-b0d6c4443a71 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:21.273126 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fcef2357-dcf4-4a04-accf-b0d6c4443a71 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:21.273786 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fcef2357-dcf4-4a04-accf-b0d6c4443a71 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:21.294643 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.wsgi [None req-fcef2357-dcf4-4a04-accf-b0d6c4443a71 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] HTTP exception thrown: Instance f8dd165f-4996-4336-a117-cd2a9ba751fa could not be found. Jun 23 13:46:21.296684 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-fcef2357-dcf4-4a04-accf-b0d6c4443a71 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Request method failure captured: Jun 23 13:46:21.296684 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: request: GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa HTTP/1.1 Jun 23 13:46:21.296684 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept: application/json Jun 23 13:46:21.296684 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept-Encoding: identity Jun 23 13:46:21.296684 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Connection: close Jun 23 13:46:21.296684 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Length: 0 Jun 23 13:46:21.296684 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Type: application/json Jun 23 13:46:21.296684 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Host: 10.222.0.26 Jun 23 13:46:21.296684 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Openstack-System-Scope: None Jun 23 13:46:21.296684 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: User-Agent: python-urllib3/1.26.9 Jun 23 13:46:21.296684 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Auth-Token: gAAAAABitG0I_HZU131M8J85RvEQOmj8LgA_2WxO2JHaCALyqdLluOOVQseCnN3b49kmuLUwl7kgpYu_nyCOuFs2D4nvXDzPB-BFMJHg1SH6Biig2M0dk2RuXu07iB9rawZfYchoQTmmnBEWqWi0vz9e6Q6R4kGGzJ8cvnvjbn-HCeyXQcr5f7s Jun 23 13:46:21.296684 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Id: None Jun 23 13:46:21.296684 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Name: None Jun 23 13:46:21.296684 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Identity-Status: Confirmed Jun 23 13:46:21.296684 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Is-Admin-Project: True Jun 23 13:46:21.296684 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Id: default Jun 23 13:46:21.296684 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Name: Default Jun 23 13:46:21.296684 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Id: 9298bf4635e84993b086309715cc7cbe Jun 23 13:46:21.296684 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Name: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:46:21.296684 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Role: member,reader Jun 23 13:46:21.296684 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Roles: member,reader Jun 23 13:46:21.298002 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9298bf4635e84993b086309715cc7cbe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9298bf4635e84993b086309715cc7cbe", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:46:21.298002 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:46:21.298002 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Id: 9298bf4635e84993b086309715cc7cbe Jun 23 13:46:21.298002 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1741631114 Jun 23 13:46:21.298002 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User: tempest-AttachVolumeNegativeTest-1741631114-project Jun 23 13:46:21.298002 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Id: default Jun 23 13:46:21.298002 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Name: Default Jun 23 13:46:21.298002 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Id: 007ce9b8109343e0914efe94c6aa6a89 Jun 23 13:46:21.298002 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Name: tempest-AttachVolumeNegativeTest-1741631114-project Jun 23 13:46:21.298002 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: method: > Jun 23 13:46:21.298002 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: exception: Instance f8dd165f-4996-4336-a117-cd2a9ba751fa could not be found. Jun 23 13:46:21.298002 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: action_args: {'id': 'f8dd165f-4996-4336-a117-cd2a9ba751fa'} Jun 23 13:46:21.298740 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:46:21.298740 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:21.298740 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:46:21.298740 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:46:21.298740 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:46:21.298740 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:46:21.298740 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:46:21.298740 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:46:21.298740 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:46:21.298740 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:46:21.298740 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8dd165f-4996-4336-a117-cd2a9ba751fa could not be found. Jun 23 13:46:21.298740 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:21.298740 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:21.298740 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:21.298740 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:21.298740 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:21.298740 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:21.298740 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:46:21.298740 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:46:21.298740 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:46:21.299960 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:46:21.299960 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:46:21.299960 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:46:21.299960 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:46:21.299960 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:46:21.299960 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:46:21.299960 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:46:21.299960 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8dd165f-4996-4336-a117-cd2a9ba751fa could not be found. Jun 23 13:46:21.299960 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:21.299960 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:21.299960 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:21.299960 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:21.299960 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:21.299960 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:21.299960 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:46:21.299960 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:46:21.299960 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8dd165f-4996-4336-a117-cd2a9ba751fa could not be found. Jun 23 13:46:21.299960 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:21.302363 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-fcef2357-dcf4-4a04-accf-b0d6c4443a71 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] Returning 404 to user: Instance f8dd165f-4996-4336-a117-cd2a9ba751fa could not be found. {{(pid=134666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:46:21.303470 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-fcef2357-dcf4-4a04-accf-b0d6c4443a71 tempest-AttachVolumeNegativeTest-1741631114 tempest-AttachVolumeNegativeTest-1741631114-project] 10.222.0.26 "GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa" status: 404 len: 111 microversion: 2.1 time: 0.044568 Jun 23 13:46:21.307865 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 445/904] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:21 2022] GET /compute/v2.1/servers/f8dd165f-4996-4336-a117-cd2a9ba751fa => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:46:24.089520 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-2c24ca69-5e02-45d6-bf17-1ee15d3b3ed2 req-3705c0ba-22fd-409e-af4e-614a131fb8d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52cbfcd2-3b2d-44f2-a44d-55ab8868fd59", "tag": "b2540c58-97f9-4f0c-98c0-3f9877fc5e17"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:46:24.099500 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-2c24ca69-5e02-45d6-bf17-1ee15d3b3ed2 req-3705c0ba-22fd-409e-af4e-614a131fb8d2 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:24.099973 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-2c24ca69-5e02-45d6-bf17-1ee15d3b3ed2 req-3705c0ba-22fd-409e-af4e-614a131fb8d2 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:24.121739 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-2c24ca69-5e02-45d6-bf17-1ee15d3b3ed2 req-3705c0ba-22fd-409e-af4e-614a131fb8d2 service nova] Creating event network-changed:b2540c58-97f9-4f0c-98c0-3f9877fc5e17 for instance 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 on hv-cinder-81558 Jun 23 13:46:24.128394 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-2c24ca69-5e02-45d6-bf17-1ee15d3b3ed2 req-3705c0ba-22fd-409e-af4e-614a131fb8d2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042832 Jun 23 13:46:24.129380 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 460/905] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 13:46:44.370333 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-489d3c64-c5d3-4dbb-975a-c5245af04646 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:44.371389 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-489d3c64-c5d3-4dbb-975a-c5245af04646 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:44.374338 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=2 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:44.375178 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:SELECT=94 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:44.381003 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-489d3c64-c5d3-4dbb-975a-c5245af04646 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:44.381454 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-489d3c64-c5d3-4dbb-975a-c5245af04646 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:44.382227 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-489d3c64-c5d3-4dbb-975a-c5245af04646 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:44.382674 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-489d3c64-c5d3-4dbb-975a-c5245af04646 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:44.413040 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-489d3c64-c5d3-4dbb-975a-c5245af04646 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046686 Jun 23 13:46:44.413596 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 446/906] 10.222.0.26 () {60 vars in 1342 bytes} [Thu Jun 23 13:46:44 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:44.473315 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:44.474226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=30 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:44.479948 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-7e7418cb-3a67-487d-8a6a-2ece659e69ae tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:44.480459 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-7e7418cb-3a67-487d-8a6a-2ece659e69ae tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:44.490812 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7e7418cb-3a67-487d-8a6a-2ece659e69ae tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:44.491268 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7e7418cb-3a67-487d-8a6a-2ece659e69ae tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:44.492070 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7e7418cb-3a67-487d-8a6a-2ece659e69ae tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:44.492504 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7e7418cb-3a67-487d-8a6a-2ece659e69ae tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:44.519557 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-7e7418cb-3a67-487d-8a6a-2ece659e69ae tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Going to try to terminate instance {{(pid=134667) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 13:46:44.621430 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-7e7418cb-3a67-487d-8a6a-2ece659e69ae tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 204 len: 0 microversion: 2.20 time: 0.149494 Jun 23 13:46:44.622701 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 461/907] 10.222.0.26 () {60 vars in 1279 bytes} [Thu Jun 23 13:46:44 2022] DELETE /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 13:46:44.631285 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-da0fd98b-524b-45ab-adea-bb243bb242ad tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:44.631964 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-da0fd98b-524b-45ab-adea-bb243bb242ad tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:44.638572 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-da0fd98b-524b-45ab-adea-bb243bb242ad tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:44.639018 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-da0fd98b-524b-45ab-adea-bb243bb242ad tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:44.640118 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-da0fd98b-524b-45ab-adea-bb243bb242ad tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:44.640733 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-da0fd98b-524b-45ab-adea-bb243bb242ad tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:44.789530 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-da0fd98b-524b-45ab-adea-bb243bb242ad tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:44.799110 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-da0fd98b-524b-45ab-adea-bb243bb242ad tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:44.800638 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-da0fd98b-524b-45ab-adea-bb243bb242ad tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:44.801795 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-da0fd98b-524b-45ab-adea-bb243bb242ad tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1723 microversion: 2.20 time: 0.174790 Jun 23 13:46:44.802388 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 447/908] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:46:44 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:46:45.821025 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-a3683613-096b-4dcf-ad1d-224669d9179e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:45.821708 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-a3683613-096b-4dcf-ad1d-224669d9179e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:45.828748 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a3683613-096b-4dcf-ad1d-224669d9179e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:45.829199 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a3683613-096b-4dcf-ad1d-224669d9179e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:45.829993 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a3683613-096b-4dcf-ad1d-224669d9179e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:45.830747 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a3683613-096b-4dcf-ad1d-224669d9179e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:45.970025 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-a3683613-096b-4dcf-ad1d-224669d9179e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:45.980639 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-a3683613-096b-4dcf-ad1d-224669d9179e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:45.982298 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-a3683613-096b-4dcf-ad1d-224669d9179e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:45.983494 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-a3683613-096b-4dcf-ad1d-224669d9179e tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1723 microversion: 2.20 time: 0.166899 Jun 23 13:46:45.984062 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 462/909] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:46:45 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:46:46.185061 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c2aea894-1ea0-4b46-9853-039ae415419b tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-921906156", "imageRef": "dd7aacbf-3b3e-496e-967e-53d2a1b1f200", "flavorRef": "452", "networks": [{"uuid": "157e0a54-4e55-4a36-8828-e724b9ae8557"}]}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:46:46.237354 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.network.neutron [None req-c2aea894-1ea0-4b46-9853-039ae415419b tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] validate_networks() for [('157e0a54-4e55-4a36-8828-e724b9ae8557', None, None, None, None, None)] {{(pid=134666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 13:46:46.586757 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-c2aea894-1ea0-4b46-9853-039ae415419b tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Flavor limits 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 13:46:46.587177 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-c2aea894-1ea0-4b46-9853-039ae415419b tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Image limits 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 13:46:46.587729 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-c2aea894-1ea0-4b46-9853-039ae415419b tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Flavor pref 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 13:46:46.588099 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-c2aea894-1ea0-4b46-9853-039ae415419b tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Image pref 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 13:46:46.588788 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-c2aea894-1ea0-4b46-9853-039ae415419b tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 13:46:46.598349 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c2aea894-1ea0-4b46-9853-039ae415419b tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:46.598793 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c2aea894-1ea0-4b46-9853-039ae415419b tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:46.599654 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c2aea894-1ea0-4b46-9853-039ae415419b tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:46.600090 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c2aea894-1ea0-4b46-9853-039ae415419b tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:46.618191 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-c2aea894-1ea0-4b46-9853-039ae415419b tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Getting quotas for project c3b6044e9c2e44009b2e7f5ee43019ac. Resources: {'ram', 'cores', 'instances'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:46:46.623123 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-c2aea894-1ea0-4b46-9853-039ae415419b tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Getting quotas for user 20d6e0c983e14de0a3d7d352d061b3ff and project c3b6044e9c2e44009b2e7f5ee43019ac. Resources: {'ram', 'cores', 'instances'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:46:46.635289 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-c2aea894-1ea0-4b46-9853-039ae415419b tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Going to run 1 instances... {{(pid=134666) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 13:46:46.637731 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-c2aea894-1ea0-4b46-9853-039ae415419b tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 90f44dc2-3872-4638-9bd9-0a587fb2edcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7aacbf-3b3e-496e-967e-53d2a1b1f200',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 13:46:46.684794 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-c2aea894-1ea0-4b46-9853-039ae415419b tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.503498 Jun 23 13:46:46.685460 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 448/910] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Jun 23 13:46:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 13:46:46.695482 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-9f11cd9d-2f8c-45d1-8dde-e38a12110beb tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:46.696110 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-9f11cd9d-2f8c-45d1-8dde-e38a12110beb tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 90f44dc2-3872-4638-9bd9-0a587fb2edcd] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:46.748618 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-9f11cd9d-2f8c-45d1-8dde-e38a12110beb tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d6e0c983e14de0a3d7d352d061b3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b6044e9c2e44009b2e7f5ee43019ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:46.756584 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-9f11cd9d-2f8c-45d1-8dde-e38a12110beb tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] 10.222.0.26 "GET /compute/v2.1/servers/90f44dc2-3872-4638-9bd9-0a587fb2edcd" status: 200 len: 1213 microversion: 2.1 time: 0.064946 Jun 23 13:46:46.766343 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 463/911] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:46 2022] GET /compute/v2.1/servers/90f44dc2-3872-4638-9bd9-0a587fb2edcd => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:46.919047 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-c1a30cac-1f8d-4e73-a096-649cd32ecfd0 req-c2566b9e-ea8e-4abd-9812-873cd5feb2d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a602a74c-fbf6-4ed0-85c6-f1778d879da7", "name": "network-vif-deleted", "tag": "2a2fc7e3-801b-47fb-9626-bb5520448495"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:46:46.931917 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-c1a30cac-1f8d-4e73-a096-649cd32ecfd0 req-c2566b9e-ea8e-4abd-9812-873cd5feb2d0 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:46.932704 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-c1a30cac-1f8d-4e73-a096-649cd32ecfd0 req-c2566b9e-ea8e-4abd-9812-873cd5feb2d0 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:46.947051 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-c1a30cac-1f8d-4e73-a096-649cd32ecfd0 req-c2566b9e-ea8e-4abd-9812-873cd5feb2d0 service nova] Creating event network-vif-deleted:2a2fc7e3-801b-47fb-9626-bb5520448495 for instance a602a74c-fbf6-4ed0-85c6-f1778d879da7 on hv-cinder-81558 Jun 23 13:46:46.952762 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-c1a30cac-1f8d-4e73-a096-649cd32ecfd0 req-c2566b9e-ea8e-4abd-9812-873cd5feb2d0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037687 Jun 23 13:46:46.953687 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 449/912] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:46:47.002035 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-f4db4bde-7915-4382-9254-5d8839242708 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:47.002867 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-f4db4bde-7915-4382-9254-5d8839242708 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:47.009307 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f4db4bde-7915-4382-9254-5d8839242708 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:47.009760 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f4db4bde-7915-4382-9254-5d8839242708 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:47.015659 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f4db4bde-7915-4382-9254-5d8839242708 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:47.016124 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f4db4bde-7915-4382-9254-5d8839242708 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:47.124290 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-f4db4bde-7915-4382-9254-5d8839242708 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:47.145934 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-f4db4bde-7915-4382-9254-5d8839242708 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:47.159430 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-f4db4bde-7915-4382-9254-5d8839242708 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b191f41e53064acbaf17e3da073e7c85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d89deaaefc541739f67ab1e53c4bda3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:47.163843 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-f4db4bde-7915-4382-9254-5d8839242708 tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 200 len: 1366 microversion: 2.20 time: 0.165540 Jun 23 13:46:47.164813 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 464/913] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:46:46 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 13:46:47.775230 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-09aebaa4-8443-4914-b5f5-18332d2c84be tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:47.775929 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-09aebaa4-8443-4914-b5f5-18332d2c84be tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 90f44dc2-3872-4638-9bd9-0a587fb2edcd] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:47.783140 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-09aebaa4-8443-4914-b5f5-18332d2c84be tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:47.783661 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-09aebaa4-8443-4914-b5f5-18332d2c84be tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:47.784475 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-09aebaa4-8443-4914-b5f5-18332d2c84be tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:47.784911 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-09aebaa4-8443-4914-b5f5-18332d2c84be tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:47.855991 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-09aebaa4-8443-4914-b5f5-18332d2c84be tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d6e0c983e14de0a3d7d352d061b3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b6044e9c2e44009b2e7f5ee43019ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:47.864007 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-09aebaa4-8443-4914-b5f5-18332d2c84be tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] 10.222.0.26 "GET /compute/v2.1/servers/90f44dc2-3872-4638-9bd9-0a587fb2edcd" status: 200 len: 1265 microversion: 2.1 time: 0.093541 Jun 23 13:46:47.864966 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 450/914] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:47 2022] GET /compute/v2.1/servers/90f44dc2-3872-4638-9bd9-0a587fb2edcd => generated 1265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:48.183313 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-541f27d8-c831-4c33-98e9-43a9cb15c77b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:48.184090 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-541f27d8-c831-4c33-98e9-43a9cb15c77b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:48.191474 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-541f27d8-c831-4c33-98e9-43a9cb15c77b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:48.192089 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-541f27d8-c831-4c33-98e9-43a9cb15c77b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:48.193032 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-541f27d8-c831-4c33-98e9-43a9cb15c77b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:48.193931 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-541f27d8-c831-4c33-98e9-43a9cb15c77b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:48.214794 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.wsgi [None req-541f27d8-c831-4c33-98e9-43a9cb15c77b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] HTTP exception thrown: Instance a602a74c-fbf6-4ed0-85c6-f1778d879da7 could not be found. Jun 23 13:46:48.216597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-541f27d8-c831-4c33-98e9-43a9cb15c77b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Request method failure captured: Jun 23 13:46:48.216597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 HTTP/1.1 Jun 23 13:46:48.216597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:46:48.216597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:46:48.216597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:46:48.216597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 0 Jun 23 13:46:48.216597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:46:48.216597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:46:48.216597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:46:48.216597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:46:48.216597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitG0Ua982nkIhWp-3rSlmbNhDgpXavmmlJ3cnUqm5xRHstr9N-gjiygFKqK1B5pPVIF2q-J75rZdWvIRlWcHf1cTERPdk9LhP6fmwjGS6rFkXRDEXvEkbTis7iFpUzIwRQUytgSw1sNI5BnjCcre3LSfuww5z9q0LC5x-OGRhWUeiyp8 Jun 23 13:46:48.216597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:46:48.216597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:46:48.216597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:46:48.216597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:46:48.216597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 13:46:48.216597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:46:48.216597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:46:48.216597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: 1d89deaaefc541739f67ab1e53c4bda3 Jun 23 13:46:48.216597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1861648293 Jun 23 13:46:48.216597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:46:48.216597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:46:48.218360 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1d89deaaefc541739f67ab1e53c4bda3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1d89deaaefc541739f67ab1e53c4bda3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1d89deaaefc541739f67ab1e53c4bda3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1d89deaaefc541739f67ab1e53c4bda3", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:46:48.218360 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1861648293 Jun 23 13:46:48.218360 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: 1d89deaaefc541739f67ab1e53c4bda3 Jun 23 13:46:48.218360 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1861648293 Jun 23 13:46:48.218360 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-AttachVolumeShelveTestJSON-1861648293-project Jun 23 13:46:48.218360 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:46:48.218360 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:46:48.218360 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: b191f41e53064acbaf17e3da073e7c85 Jun 23 13:46:48.218360 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1861648293-project Jun 23 13:46:48.218360 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: > Jun 23 13:46:48.218360 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Instance a602a74c-fbf6-4ed0-85c6-f1778d879da7 could not be found. Jun 23 13:46:48.218360 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'id': 'a602a74c-fbf6-4ed0-85c6-f1778d879da7'} Jun 23 13:46:48.219310 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:46:48.219310 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:48.219310 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:46:48.219310 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:46:48.219310 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:46:48.219310 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:46:48.219310 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:46:48.219310 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:46:48.219310 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:46:48.219310 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:46:48.219310 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a602a74c-fbf6-4ed0-85c6-f1778d879da7 could not be found. Jun 23 13:46:48.219310 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:48.219310 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:48.219310 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:48.219310 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:48.219310 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:48.219310 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:48.219310 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:46:48.219310 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:46:48.219310 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:46:48.221012 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:46:48.221012 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:46:48.221012 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:46:48.221012 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:46:48.221012 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:46:48.221012 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:46:48.221012 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:46:48.221012 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a602a74c-fbf6-4ed0-85c6-f1778d879da7 could not be found. Jun 23 13:46:48.221012 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:48.221012 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:48.221012 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:48.221012 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:48.221012 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:48.221012 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:48.221012 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:46:48.221012 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:46:48.221012 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a602a74c-fbf6-4ed0-85c6-f1778d879da7 could not be found. Jun 23 13:46:48.221012 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:48.222352 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-541f27d8-c831-4c33-98e9-43a9cb15c77b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Returning 404 to user: Instance a602a74c-fbf6-4ed0-85c6-f1778d879da7 could not be found. {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:46:48.222352 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-541f27d8-c831-4c33-98e9-43a9cb15c77b tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 404 len: 111 microversion: 2.20 time: 0.040276 Jun 23 13:46:48.222352 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 465/915] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:46:48 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 13:46:48.230067 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-5a40f2b1-01e2-4dff-a3a4-893998238cdb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '.version_select at 0x7fd772375e50>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:48.250238 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-5a40f2b1-01e2-4dff-a3a4-893998238cdb tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-629360403" status: 204 len: 0 microversion: 2.20 time: 0.023991 Jun 23 13:46:48.250865 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 451/916] 10.222.0.26 () {60 vars in 1258 bytes} [Thu Jun 23 13:46:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-629360403 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 23 13:46:48.881378 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-874f8f60-6f24-43d7-8f33-3055164c885f tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:48.882107 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-874f8f60-6f24-43d7-8f33-3055164c885f tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 90f44dc2-3872-4638-9bd9-0a587fb2edcd] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:48.888573 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-874f8f60-6f24-43d7-8f33-3055164c885f tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:48.889126 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-874f8f60-6f24-43d7-8f33-3055164c885f tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:48.889968 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-874f8f60-6f24-43d7-8f33-3055164c885f tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:48.890469 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-874f8f60-6f24-43d7-8f33-3055164c885f tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:49.036615 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-874f8f60-6f24-43d7-8f33-3055164c885f tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d6e0c983e14de0a3d7d352d061b3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b6044e9c2e44009b2e7f5ee43019ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:49.044502 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-874f8f60-6f24-43d7-8f33-3055164c885f tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] 10.222.0.26 "GET /compute/v2.1/servers/90f44dc2-3872-4638-9bd9-0a587fb2edcd" status: 200 len: 1313 microversion: 2.1 time: 0.166929 Jun 23 13:46:49.045070 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 466/917] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:48 2022] GET /compute/v2.1/servers/90f44dc2-3872-4638-9bd9-0a587fb2edcd => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:49.256374 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-6f47e111-4244-42ca-8ea7-1ad2a5457a8e req-b865db37-2774-487c-9fef-0348a2dafe0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90f44dc2-3872-4638-9bd9-0a587fb2edcd", "tag": "c096e153-d3b5-435f-85d7-52eef0231b06"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:46:49.267676 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-6f47e111-4244-42ca-8ea7-1ad2a5457a8e req-b865db37-2774-487c-9fef-0348a2dafe0e service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:49.268143 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-6f47e111-4244-42ca-8ea7-1ad2a5457a8e req-b865db37-2774-487c-9fef-0348a2dafe0e service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:49.280310 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-6f47e111-4244-42ca-8ea7-1ad2a5457a8e req-b865db37-2774-487c-9fef-0348a2dafe0e service nova] Creating event network-changed:c096e153-d3b5-435f-85d7-52eef0231b06 for instance 90f44dc2-3872-4638-9bd9-0a587fb2edcd on hv-cinder-81558 Jun 23 13:46:49.285036 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-6f47e111-4244-42ca-8ea7-1ad2a5457a8e req-b865db37-2774-487c-9fef-0348a2dafe0e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033203 Jun 23 13:46:49.285824 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 452/918] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:46:50.027711 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-01de9e9f-f943-4738-9251-a128d631712f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:50.028227 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-01de9e9f-f943-4738-9251-a128d631712f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:50.038308 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-01de9e9f-f943-4738-9251-a128d631712f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:50.038891 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-01de9e9f-f943-4738-9251-a128d631712f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:50.040098 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-01de9e9f-f943-4738-9251-a128d631712f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:50.040753 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-01de9e9f-f943-4738-9251-a128d631712f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:50.056022 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.wsgi [None req-01de9e9f-f943-4738-9251-a128d631712f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] HTTP exception thrown: Instance a602a74c-fbf6-4ed0-85c6-f1778d879da7 could not be found. Jun 23 13:46:50.057704 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-01de9e9f-f943-4738-9251-a128d631712f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Request method failure captured: Jun 23 13:46:50.057704 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: DELETE /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 HTTP/1.1 Jun 23 13:46:50.057704 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:46:50.057704 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:46:50.057704 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:46:50.057704 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 0 Jun 23 13:46:50.057704 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:46:50.057704 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:46:50.057704 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:46:50.057704 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:46:50.057704 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitG0Ua982nkIhWp-3rSlmbNhDgpXavmmlJ3cnUqm5xRHstr9N-gjiygFKqK1B5pPVIF2q-J75rZdWvIRlWcHf1cTERPdk9LhP6fmwjGS6rFkXRDEXvEkbTis7iFpUzIwRQUytgSw1sNI5BnjCcre3LSfuww5z9q0LC5x-OGRhWUeiyp8 Jun 23 13:46:50.057704 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:46:50.057704 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:46:50.057704 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:46:50.057704 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:46:50.057704 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 13:46:50.057704 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:46:50.057704 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:46:50.057704 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: 1d89deaaefc541739f67ab1e53c4bda3 Jun 23 13:46:50.057704 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1861648293 Jun 23 13:46:50.057704 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:46:50.057704 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:46:50.059288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1d89deaaefc541739f67ab1e53c4bda3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1d89deaaefc541739f67ab1e53c4bda3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1d89deaaefc541739f67ab1e53c4bda3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1d89deaaefc541739f67ab1e53c4bda3", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:46:50.059288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1861648293 Jun 23 13:46:50.059288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: 1d89deaaefc541739f67ab1e53c4bda3 Jun 23 13:46:50.059288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1861648293 Jun 23 13:46:50.059288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-AttachVolumeShelveTestJSON-1861648293-project Jun 23 13:46:50.059288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:46:50.059288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:46:50.059288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: b191f41e53064acbaf17e3da073e7c85 Jun 23 13:46:50.059288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1861648293-project Jun 23 13:46:50.059288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: > Jun 23 13:46:50.059288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Instance a602a74c-fbf6-4ed0-85c6-f1778d879da7 could not be found. Jun 23 13:46:50.059288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'id': 'a602a74c-fbf6-4ed0-85c6-f1778d879da7'} Jun 23 13:46:50.060207 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:46:50.060207 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:50.060207 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:46:50.060207 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:46:50.060207 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:46:50.060207 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:46:50.060207 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:46:50.060207 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:46:50.060207 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:46:50.060207 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:46:50.060207 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a602a74c-fbf6-4ed0-85c6-f1778d879da7 could not be found. Jun 23 13:46:50.060207 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:50.060207 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:50.060207 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:50.060207 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:50.060207 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:50.060207 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:50.060207 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:46:50.060207 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:46:50.060207 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:46:50.061557 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:46:50.061557 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 13:46:50.061557 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 13:46:50.061557 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 13:46:50.061557 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 13:46:50.061557 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:46:50.061557 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:46:50.061557 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:46:50.061557 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:46:50.061557 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a602a74c-fbf6-4ed0-85c6-f1778d879da7 could not be found. Jun 23 13:46:50.061557 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:50.061557 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:50.061557 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:50.061557 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:50.061557 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:50.061557 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:50.061557 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:46:50.061557 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:46:50.061557 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a602a74c-fbf6-4ed0-85c6-f1778d879da7 could not be found. Jun 23 13:46:50.061557 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:50.063294 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-01de9e9f-f943-4738-9251-a128d631712f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Returning 404 to user: Instance a602a74c-fbf6-4ed0-85c6-f1778d879da7 could not be found. {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:46:50.063294 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-01de9e9f-f943-4738-9251-a128d631712f tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 404 len: 111 microversion: 2.20 time: 0.037832 Jun 23 13:46:50.063294 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 467/919] 10.222.0.26 () {60 vars in 1279 bytes} [Thu Jun 23 13:46:50 2022] DELETE /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 13:46:50.065196 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-d0bd88ca-0bfe-466e-85f8-431bec314682 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:50.065923 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-d0bd88ca-0bfe-466e-85f8-431bec314682 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 90f44dc2-3872-4638-9bd9-0a587fb2edcd] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:50.067118 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-1fdd0960-96a9-45e6-afa4-bb4356d7b44d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:50.067755 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-1fdd0960-96a9-45e6-afa4-bb4356d7b44d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: a602a74c-fbf6-4ed0-85c6-f1778d879da7] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:50.072524 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d0bd88ca-0bfe-466e-85f8-431bec314682 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:50.073087 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d0bd88ca-0bfe-466e-85f8-431bec314682 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:50.074173 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d0bd88ca-0bfe-466e-85f8-431bec314682 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:50.074684 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d0bd88ca-0bfe-466e-85f8-431bec314682 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:50.075192 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1fdd0960-96a9-45e6-afa4-bb4356d7b44d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:50.075671 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1fdd0960-96a9-45e6-afa4-bb4356d7b44d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:50.076429 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1fdd0960-96a9-45e6-afa4-bb4356d7b44d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:50.076966 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1fdd0960-96a9-45e6-afa4-bb4356d7b44d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:50.098746 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.wsgi [None req-1fdd0960-96a9-45e6-afa4-bb4356d7b44d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] HTTP exception thrown: Instance a602a74c-fbf6-4ed0-85c6-f1778d879da7 could not be found. Jun 23 13:46:50.100373 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-1fdd0960-96a9-45e6-afa4-bb4356d7b44d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Request method failure captured: Jun 23 13:46:50.100373 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 HTTP/1.1 Jun 23 13:46:50.100373 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:46:50.100373 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:46:50.100373 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:46:50.100373 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 0 Jun 23 13:46:50.100373 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:46:50.100373 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:46:50.100373 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:46:50.100373 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:46:50.100373 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitG0Ua982nkIhWp-3rSlmbNhDgpXavmmlJ3cnUqm5xRHstr9N-gjiygFKqK1B5pPVIF2q-J75rZdWvIRlWcHf1cTERPdk9LhP6fmwjGS6rFkXRDEXvEkbTis7iFpUzIwRQUytgSw1sNI5BnjCcre3LSfuww5z9q0LC5x-OGRhWUeiyp8 Jun 23 13:46:50.100373 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:46:50.100373 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:46:50.100373 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:46:50.100373 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:46:50.100373 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 13:46:50.100373 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:46:50.100373 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:46:50.100373 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: 1d89deaaefc541739f67ab1e53c4bda3 Jun 23 13:46:50.100373 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1861648293 Jun 23 13:46:50.100373 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:46:50.100373 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:46:50.102067 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1d89deaaefc541739f67ab1e53c4bda3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1d89deaaefc541739f67ab1e53c4bda3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1d89deaaefc541739f67ab1e53c4bda3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1d89deaaefc541739f67ab1e53c4bda3", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:46:50.102067 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1861648293 Jun 23 13:46:50.102067 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: 1d89deaaefc541739f67ab1e53c4bda3 Jun 23 13:46:50.102067 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1861648293 Jun 23 13:46:50.102067 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-AttachVolumeShelveTestJSON-1861648293-project Jun 23 13:46:50.102067 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:46:50.102067 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:46:50.102067 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: b191f41e53064acbaf17e3da073e7c85 Jun 23 13:46:50.102067 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1861648293-project Jun 23 13:46:50.102067 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: > Jun 23 13:46:50.102067 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Instance a602a74c-fbf6-4ed0-85c6-f1778d879da7 could not be found. Jun 23 13:46:50.102067 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'id': 'a602a74c-fbf6-4ed0-85c6-f1778d879da7'} Jun 23 13:46:50.102875 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:46:50.102875 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:50.102875 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:46:50.102875 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:46:50.102875 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:46:50.102875 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:46:50.102875 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:46:50.102875 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:46:50.102875 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:46:50.102875 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:46:50.102875 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a602a74c-fbf6-4ed0-85c6-f1778d879da7 could not be found. Jun 23 13:46:50.102875 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:50.102875 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:50.102875 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:50.102875 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:50.102875 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:50.102875 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:50.102875 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:46:50.102875 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:46:50.102875 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:46:50.104372 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:46:50.104372 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:46:50.104372 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:46:50.104372 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:46:50.104372 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:46:50.104372 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:46:50.104372 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:46:50.104372 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a602a74c-fbf6-4ed0-85c6-f1778d879da7 could not be found. Jun 23 13:46:50.104372 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:50.104372 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:50.104372 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:50.104372 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:50.104372 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:50.104372 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:50.104372 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:46:50.104372 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:46:50.104372 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a602a74c-fbf6-4ed0-85c6-f1778d879da7 could not be found. Jun 23 13:46:50.104372 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:46:50.105871 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-1fdd0960-96a9-45e6-afa4-bb4356d7b44d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Returning 404 to user: Instance a602a74c-fbf6-4ed0-85c6-f1778d879da7 could not be found. {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:46:50.105871 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-1fdd0960-96a9-45e6-afa4-bb4356d7b44d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7" status: 404 len: 111 microversion: 2.20 time: 0.038276 Jun 23 13:46:50.105871 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 468/920] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:46:50 2022] GET /compute/v2.1/servers/a602a74c-fbf6-4ed0-85c6-f1778d879da7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 23 13:46:50.215389 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-d0bd88ca-0bfe-466e-85f8-431bec314682 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d6e0c983e14de0a3d7d352d061b3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b6044e9c2e44009b2e7f5ee43019ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:50.222924 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-d0bd88ca-0bfe-466e-85f8-431bec314682 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] 10.222.0.26 "GET /compute/v2.1/servers/90f44dc2-3872-4638-9bd9-0a587fb2edcd" status: 200 len: 1313 microversion: 2.1 time: 0.164861 Jun 23 13:46:50.223587 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 453/921] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:50 2022] GET /compute/v2.1/servers/90f44dc2-3872-4638-9bd9-0a587fb2edcd => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:51.243476 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-fbb530af-c2d5-44e2-9743-8e965b52f33a tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:51.244489 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-fbb530af-c2d5-44e2-9743-8e965b52f33a tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 90f44dc2-3872-4638-9bd9-0a587fb2edcd] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:51.253355 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fbb530af-c2d5-44e2-9743-8e965b52f33a tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:51.253865 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fbb530af-c2d5-44e2-9743-8e965b52f33a tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:51.254666 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fbb530af-c2d5-44e2-9743-8e965b52f33a tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:51.255122 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fbb530af-c2d5-44e2-9743-8e965b52f33a tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:51.255578 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-8ab31d86-329f-4b56-9b41-7a765628066d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:51.256112 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-8ab31d86-329f-4b56-9b41-7a765628066d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:51.262948 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8ab31d86-329f-4b56-9b41-7a765628066d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:51.263621 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8ab31d86-329f-4b56-9b41-7a765628066d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:51.264392 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8ab31d86-329f-4b56-9b41-7a765628066d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:51.264888 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8ab31d86-329f-4b56-9b41-7a765628066d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:51.278505 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.wsgi [None req-8ab31d86-329f-4b56-9b41-7a765628066d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] HTTP exception thrown: Instance b9ddb941-db20-4a0c-b841-d99368ad4f21 could not be found. Jun 23 13:46:51.280219 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-8ab31d86-329f-4b56-9b41-7a765628066d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Request method failure captured: Jun 23 13:46:51.280219 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: request: DELETE /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 HTTP/1.1 Jun 23 13:46:51.280219 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept: application/json Jun 23 13:46:51.280219 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept-Encoding: identity Jun 23 13:46:51.280219 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Connection: close Jun 23 13:46:51.280219 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Length: 0 Jun 23 13:46:51.280219 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Type: application/json Jun 23 13:46:51.280219 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Host: 10.222.0.26 Jun 23 13:46:51.280219 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Openstack-System-Scope: None Jun 23 13:46:51.280219 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: User-Agent: python-urllib3/1.26.9 Jun 23 13:46:51.280219 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Auth-Token: gAAAAABitG0Ua982nkIhWp-3rSlmbNhDgpXavmmlJ3cnUqm5xRHstr9N-gjiygFKqK1B5pPVIF2q-J75rZdWvIRlWcHf1cTERPdk9LhP6fmwjGS6rFkXRDEXvEkbTis7iFpUzIwRQUytgSw1sNI5BnjCcre3LSfuww5z9q0LC5x-OGRhWUeiyp8 Jun 23 13:46:51.280219 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Id: None Jun 23 13:46:51.280219 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Name: None Jun 23 13:46:51.280219 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Identity-Status: Confirmed Jun 23 13:46:51.280219 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Is-Admin-Project: True Jun 23 13:46:51.280219 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 13:46:51.280219 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Id: default Jun 23 13:46:51.280219 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Name: Default Jun 23 13:46:51.280219 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Id: 1d89deaaefc541739f67ab1e53c4bda3 Jun 23 13:46:51.280219 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1861648293 Jun 23 13:46:51.280219 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Role: member,reader Jun 23 13:46:51.280219 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Roles: member,reader Jun 23 13:46:51.281913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1d89deaaefc541739f67ab1e53c4bda3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1d89deaaefc541739f67ab1e53c4bda3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1d89deaaefc541739f67ab1e53c4bda3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1d89deaaefc541739f67ab1e53c4bda3", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:46:51.281913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1861648293 Jun 23 13:46:51.281913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Id: 1d89deaaefc541739f67ab1e53c4bda3 Jun 23 13:46:51.281913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1861648293 Jun 23 13:46:51.281913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User: tempest-AttachVolumeShelveTestJSON-1861648293-project Jun 23 13:46:51.281913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Id: default Jun 23 13:46:51.281913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Name: Default Jun 23 13:46:51.281913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Id: b191f41e53064acbaf17e3da073e7c85 Jun 23 13:46:51.281913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1861648293-project Jun 23 13:46:51.281913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: method: > Jun 23 13:46:51.281913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: exception: Instance b9ddb941-db20-4a0c-b841-d99368ad4f21 could not be found. Jun 23 13:46:51.281913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: action_args: {'id': 'b9ddb941-db20-4a0c-b841-d99368ad4f21'} Jun 23 13:46:51.282699 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:46:51.282699 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:51.282699 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:46:51.282699 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:46:51.282699 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:46:51.282699 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:46:51.282699 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:46:51.282699 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:46:51.282699 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:46:51.282699 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:46:51.282699 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9ddb941-db20-4a0c-b841-d99368ad4f21 could not be found. Jun 23 13:46:51.282699 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:51.282699 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:51.282699 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:51.282699 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:51.282699 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:51.282699 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:51.282699 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:46:51.282699 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:46:51.282699 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:46:51.283994 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:46:51.283994 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 13:46:51.283994 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 13:46:51.283994 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 13:46:51.283994 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 13:46:51.283994 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:46:51.283994 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:46:51.283994 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:46:51.283994 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:46:51.283994 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9ddb941-db20-4a0c-b841-d99368ad4f21 could not be found. Jun 23 13:46:51.283994 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:51.283994 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:51.283994 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:51.283994 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:51.283994 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:51.283994 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:51.283994 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:46:51.283994 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:46:51.283994 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9ddb941-db20-4a0c-b841-d99368ad4f21 could not be found. Jun 23 13:46:51.283994 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:51.285189 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-8ab31d86-329f-4b56-9b41-7a765628066d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Returning 404 to user: Instance b9ddb941-db20-4a0c-b841-d99368ad4f21 could not be found. {{(pid=134666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:46:51.285189 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-8ab31d86-329f-4b56-9b41-7a765628066d tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 404 len: 111 microversion: 2.20 time: 0.030059 Jun 23 13:46:51.285189 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 454/922] 10.222.0.26 () {60 vars in 1279 bytes} [Thu Jun 23 13:46:51 2022] DELETE /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 13:46:51.289777 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-1da7a9c3-cddf-4fe7-86ac-3ff74f9ac7fd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:51.290386 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-1da7a9c3-cddf-4fe7-86ac-3ff74f9ac7fd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] [instance: b9ddb941-db20-4a0c-b841-d99368ad4f21] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:51.296471 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1da7a9c3-cddf-4fe7-86ac-3ff74f9ac7fd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:51.296925 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1da7a9c3-cddf-4fe7-86ac-3ff74f9ac7fd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:51.297690 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1da7a9c3-cddf-4fe7-86ac-3ff74f9ac7fd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:51.298127 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-1da7a9c3-cddf-4fe7-86ac-3ff74f9ac7fd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:51.312359 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.wsgi [None req-1da7a9c3-cddf-4fe7-86ac-3ff74f9ac7fd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] HTTP exception thrown: Instance b9ddb941-db20-4a0c-b841-d99368ad4f21 could not be found. Jun 23 13:46:51.313877 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-1da7a9c3-cddf-4fe7-86ac-3ff74f9ac7fd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Request method failure captured: Jun 23 13:46:51.313877 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: request: GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 HTTP/1.1 Jun 23 13:46:51.313877 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept: application/json Jun 23 13:46:51.313877 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept-Encoding: identity Jun 23 13:46:51.313877 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Connection: close Jun 23 13:46:51.313877 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Length: 0 Jun 23 13:46:51.313877 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Type: application/json Jun 23 13:46:51.313877 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Host: 10.222.0.26 Jun 23 13:46:51.313877 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Openstack-System-Scope: None Jun 23 13:46:51.313877 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: User-Agent: python-urllib3/1.26.9 Jun 23 13:46:51.313877 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Auth-Token: gAAAAABitG0Ua982nkIhWp-3rSlmbNhDgpXavmmlJ3cnUqm5xRHstr9N-gjiygFKqK1B5pPVIF2q-J75rZdWvIRlWcHf1cTERPdk9LhP6fmwjGS6rFkXRDEXvEkbTis7iFpUzIwRQUytgSw1sNI5BnjCcre3LSfuww5z9q0LC5x-OGRhWUeiyp8 Jun 23 13:46:51.313877 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Id: None Jun 23 13:46:51.313877 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Name: None Jun 23 13:46:51.313877 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Identity-Status: Confirmed Jun 23 13:46:51.313877 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Is-Admin-Project: True Jun 23 13:46:51.313877 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 13:46:51.313877 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Id: default Jun 23 13:46:51.313877 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Name: Default Jun 23 13:46:51.313877 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Id: 1d89deaaefc541739f67ab1e53c4bda3 Jun 23 13:46:51.313877 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1861648293 Jun 23 13:46:51.313877 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Role: member,reader Jun 23 13:46:51.313877 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Roles: member,reader Jun 23 13:46:51.315671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1d89deaaefc541739f67ab1e53c4bda3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1d89deaaefc541739f67ab1e53c4bda3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1d89deaaefc541739f67ab1e53c4bda3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1d89deaaefc541739f67ab1e53c4bda3", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:46:51.315671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1861648293 Jun 23 13:46:51.315671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Id: 1d89deaaefc541739f67ab1e53c4bda3 Jun 23 13:46:51.315671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1861648293 Jun 23 13:46:51.315671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User: tempest-AttachVolumeShelveTestJSON-1861648293-project Jun 23 13:46:51.315671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Id: default Jun 23 13:46:51.315671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Name: Default Jun 23 13:46:51.315671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Id: b191f41e53064acbaf17e3da073e7c85 Jun 23 13:46:51.315671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1861648293-project Jun 23 13:46:51.315671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: method: > Jun 23 13:46:51.315671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: exception: Instance b9ddb941-db20-4a0c-b841-d99368ad4f21 could not be found. Jun 23 13:46:51.315671 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: action_args: {'id': 'b9ddb941-db20-4a0c-b841-d99368ad4f21'} Jun 23 13:46:51.316600 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:46:51.316600 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:51.316600 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:46:51.316600 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:46:51.316600 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:46:51.316600 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:46:51.316600 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:46:51.316600 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:46:51.316600 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:46:51.316600 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:46:51.316600 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9ddb941-db20-4a0c-b841-d99368ad4f21 could not be found. Jun 23 13:46:51.316600 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:51.316600 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:51.316600 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:51.316600 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:51.316600 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:51.316600 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:51.316600 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:46:51.316600 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:46:51.316600 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:46:51.317837 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:46:51.317837 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:46:51.317837 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:46:51.317837 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:46:51.317837 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:46:51.317837 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:46:51.317837 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:46:51.317837 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9ddb941-db20-4a0c-b841-d99368ad4f21 could not be found. Jun 23 13:46:51.317837 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:51.317837 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:46:51.317837 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:51.317837 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:46:51.317837 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:46:51.317837 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:46:51.317837 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:46:51.317837 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:46:51.317837 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9ddb941-db20-4a0c-b841-d99368ad4f21 could not be found. Jun 23 13:46:51.317837 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:46:51.318940 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-1da7a9c3-cddf-4fe7-86ac-3ff74f9ac7fd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] Returning 404 to user: Instance b9ddb941-db20-4a0c-b841-d99368ad4f21 could not be found. {{(pid=134666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:46:51.318940 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-1da7a9c3-cddf-4fe7-86ac-3ff74f9ac7fd tempest-AttachVolumeShelveTestJSON-1861648293 tempest-AttachVolumeShelveTestJSON-1861648293-project] 10.222.0.26 "GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21" status: 404 len: 111 microversion: 2.20 time: 0.029185 Jun 23 13:46:51.318940 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 455/923] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Jun 23 13:46:51 2022] GET /compute/v2.1/servers/b9ddb941-db20-4a0c-b841-d99368ad4f21 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 13:46:51.428005 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-fbb530af-c2d5-44e2-9743-8e965b52f33a tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d6e0c983e14de0a3d7d352d061b3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b6044e9c2e44009b2e7f5ee43019ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:51.435771 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-fbb530af-c2d5-44e2-9743-8e965b52f33a tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] 10.222.0.26 "GET /compute/v2.1/servers/90f44dc2-3872-4638-9bd9-0a587fb2edcd" status: 200 len: 1313 microversion: 2.1 time: 0.198565 Jun 23 13:46:51.436949 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 469/924] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:51 2022] GET /compute/v2.1/servers/90f44dc2-3872-4638-9bd9-0a587fb2edcd => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:52.454090 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-b0934315-0282-45f3-aec8-d1845e00b5a4 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:52.454710 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-b0934315-0282-45f3-aec8-d1845e00b5a4 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 90f44dc2-3872-4638-9bd9-0a587fb2edcd] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:52.461926 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b0934315-0282-45f3-aec8-d1845e00b5a4 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:52.462376 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b0934315-0282-45f3-aec8-d1845e00b5a4 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:52.463131 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b0934315-0282-45f3-aec8-d1845e00b5a4 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:52.463821 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-b0934315-0282-45f3-aec8-d1845e00b5a4 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:52.723548 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-b0934315-0282-45f3-aec8-d1845e00b5a4 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d6e0c983e14de0a3d7d352d061b3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b6044e9c2e44009b2e7f5ee43019ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:52.731230 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-b0934315-0282-45f3-aec8-d1845e00b5a4 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] 10.222.0.26 "GET /compute/v2.1/servers/90f44dc2-3872-4638-9bd9-0a587fb2edcd" status: 200 len: 1313 microversion: 2.1 time: 0.281155 Jun 23 13:46:52.732081 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 456/925] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:52 2022] GET /compute/v2.1/servers/90f44dc2-3872-4638-9bd9-0a587fb2edcd => generated 1313 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:53.650716 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-7115106d-977f-40e1-9b3a-9052d1698295 req-9c190d91-5f38-4ec2-adda-db8daae7a740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90f44dc2-3872-4638-9bd9-0a587fb2edcd", "name": "network-vif-plugged", "status": "completed", "tag": "c096e153-d3b5-435f-85d7-52eef0231b06"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:46:53.660446 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-7115106d-977f-40e1-9b3a-9052d1698295 req-9c190d91-5f38-4ec2-adda-db8daae7a740 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:53.660896 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-7115106d-977f-40e1-9b3a-9052d1698295 req-9c190d91-5f38-4ec2-adda-db8daae7a740 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:53.675733 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-7115106d-977f-40e1-9b3a-9052d1698295 req-9c190d91-5f38-4ec2-adda-db8daae7a740 service nova] Creating event network-vif-plugged:c096e153-d3b5-435f-85d7-52eef0231b06 for instance 90f44dc2-3872-4638-9bd9-0a587fb2edcd on hv-cinder-81558 Jun 23 13:46:53.680971 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-7115106d-977f-40e1-9b3a-9052d1698295 req-9c190d91-5f38-4ec2-adda-db8daae7a740 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034204 Jun 23 13:46:53.681723 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 470/926] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 13:46:53.748906 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-75d32b81-0400-4402-a656-ebaed8f4af04 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:53.749508 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-75d32b81-0400-4402-a656-ebaed8f4af04 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 90f44dc2-3872-4638-9bd9-0a587fb2edcd] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:53.756097 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-75d32b81-0400-4402-a656-ebaed8f4af04 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:53.756545 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-75d32b81-0400-4402-a656-ebaed8f4af04 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:53.757624 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-75d32b81-0400-4402-a656-ebaed8f4af04 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:53.758387 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-75d32b81-0400-4402-a656-ebaed8f4af04 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:53.987622 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-75d32b81-0400-4402-a656-ebaed8f4af04 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d6e0c983e14de0a3d7d352d061b3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b6044e9c2e44009b2e7f5ee43019ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:53.998199 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-75d32b81-0400-4402-a656-ebaed8f4af04 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] 10.222.0.26 "GET /compute/v2.1/servers/90f44dc2-3872-4638-9bd9-0a587fb2edcd" status: 200 len: 1313 microversion: 2.1 time: 0.253498 Jun 23 13:46:53.998820 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 457/927] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:53 2022] GET /compute/v2.1/servers/90f44dc2-3872-4638-9bd9-0a587fb2edcd => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:55.016811 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-afcc1969-90cf-427d-acd7-7dddbb898d9d tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:55.017715 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-afcc1969-90cf-427d-acd7-7dddbb898d9d tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 90f44dc2-3872-4638-9bd9-0a587fb2edcd] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:55.024427 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-afcc1969-90cf-427d-acd7-7dddbb898d9d tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:55.024851 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-afcc1969-90cf-427d-acd7-7dddbb898d9d tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:55.025609 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-afcc1969-90cf-427d-acd7-7dddbb898d9d tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:55.026038 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-afcc1969-90cf-427d-acd7-7dddbb898d9d tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:55.167044 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-afcc1969-90cf-427d-acd7-7dddbb898d9d tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d6e0c983e14de0a3d7d352d061b3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b6044e9c2e44009b2e7f5ee43019ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:55.174817 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-afcc1969-90cf-427d-acd7-7dddbb898d9d tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] 10.222.0.26 "GET /compute/v2.1/servers/90f44dc2-3872-4638-9bd9-0a587fb2edcd" status: 200 len: 1313 microversion: 2.1 time: 0.162818 Jun 23 13:46:55.175228 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 471/928] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:55 2022] GET /compute/v2.1/servers/90f44dc2-3872-4638-9bd9-0a587fb2edcd => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:56.191971 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-0f9fd107-6e48-4b8f-95c9-cda711b9e0b9 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:56.192585 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-0f9fd107-6e48-4b8f-95c9-cda711b9e0b9 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 90f44dc2-3872-4638-9bd9-0a587fb2edcd] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:56.200021 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0f9fd107-6e48-4b8f-95c9-cda711b9e0b9 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:56.200355 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0f9fd107-6e48-4b8f-95c9-cda711b9e0b9 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:56.201143 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0f9fd107-6e48-4b8f-95c9-cda711b9e0b9 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:56.201571 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0f9fd107-6e48-4b8f-95c9-cda711b9e0b9 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:56.344436 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-0f9fd107-6e48-4b8f-95c9-cda711b9e0b9 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d6e0c983e14de0a3d7d352d061b3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b6044e9c2e44009b2e7f5ee43019ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:56.352061 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-0f9fd107-6e48-4b8f-95c9-cda711b9e0b9 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] 10.222.0.26 "GET /compute/v2.1/servers/90f44dc2-3872-4638-9bd9-0a587fb2edcd" status: 200 len: 1497 microversion: 2.1 time: 0.164066 Jun 23 13:46:56.352701 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 458/929] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:56 2022] GET /compute/v2.1/servers/90f44dc2-3872-4638-9bd9-0a587fb2edcd => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:56.767329 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-e95042d7-f5c5-4c14-8cc2-c90ee8649507 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:56.768153 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-e95042d7-f5c5-4c14-8cc2-c90ee8649507 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 90f44dc2-3872-4638-9bd9-0a587fb2edcd] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:56.774213 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell0:SELECT=2 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:56.776619 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e95042d7-f5c5-4c14-8cc2-c90ee8649507 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:56.777079 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e95042d7-f5c5-4c14-8cc2-c90ee8649507 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:56.778237 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e95042d7-f5c5-4c14-8cc2-c90ee8649507 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:56.778637 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e95042d7-f5c5-4c14-8cc2-c90ee8649507 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:56.804783 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-e95042d7-f5c5-4c14-8cc2-c90ee8649507 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 90f44dc2-3872-4638-9bd9-0a587fb2edcd] Going to try to terminate instance {{(pid=134667) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 13:46:56.894916 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-e95042d7-f5c5-4c14-8cc2-c90ee8649507 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] 10.222.0.26 "DELETE /compute/v2.1/servers/90f44dc2-3872-4638-9bd9-0a587fb2edcd" status: 204 len: 0 microversion: 2.1 time: 0.130679 Jun 23 13:46:56.895979 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 472/930] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Jun 23 13:46:56 2022] DELETE /compute/v2.1/servers/90f44dc2-3872-4638-9bd9-0a587fb2edcd => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 13:46:56.905207 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-2c9561c0-51ad-4a1e-a034-86cbf5da9c1a tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:56.906090 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-2c9561c0-51ad-4a1e-a034-86cbf5da9c1a tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 90f44dc2-3872-4638-9bd9-0a587fb2edcd] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:56.913316 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell0:SELECT=2 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:56.915712 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell0:SELECT=6 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:46:56.918823 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2c9561c0-51ad-4a1e-a034-86cbf5da9c1a tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:56.919292 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2c9561c0-51ad-4a1e-a034-86cbf5da9c1a tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:56.920347 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2c9561c0-51ad-4a1e-a034-86cbf5da9c1a tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:56.920982 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2c9561c0-51ad-4a1e-a034-86cbf5da9c1a tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:57.075235 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-2c9561c0-51ad-4a1e-a034-86cbf5da9c1a tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d6e0c983e14de0a3d7d352d061b3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b6044e9c2e44009b2e7f5ee43019ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:57.086298 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-2c9561c0-51ad-4a1e-a034-86cbf5da9c1a tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] 10.222.0.26 "GET /compute/v2.1/servers/90f44dc2-3872-4638-9bd9-0a587fb2edcd" status: 200 len: 1503 microversion: 2.1 time: 0.185949 Jun 23 13:46:57.087068 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 459/931] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:56 2022] GET /compute/v2.1/servers/90f44dc2-3872-4638-9bd9-0a587fb2edcd => generated 1503 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:58.112988 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-1d31f5b9-3eff-49e6-8a93-7a2332ebbc06 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:58.114233 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-1d31f5b9-3eff-49e6-8a93-7a2332ebbc06 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 90f44dc2-3872-4638-9bd9-0a587fb2edcd] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:58.121719 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1d31f5b9-3eff-49e6-8a93-7a2332ebbc06 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:58.122417 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1d31f5b9-3eff-49e6-8a93-7a2332ebbc06 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:58.123392 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1d31f5b9-3eff-49e6-8a93-7a2332ebbc06 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:58.124020 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1d31f5b9-3eff-49e6-8a93-7a2332ebbc06 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:58.309381 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-1d31f5b9-3eff-49e6-8a93-7a2332ebbc06 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d6e0c983e14de0a3d7d352d061b3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b6044e9c2e44009b2e7f5ee43019ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:58.318248 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-1d31f5b9-3eff-49e6-8a93-7a2332ebbc06 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] 10.222.0.26 "GET /compute/v2.1/servers/90f44dc2-3872-4638-9bd9-0a587fb2edcd" status: 200 len: 1503 microversion: 2.1 time: 0.216826 Jun 23 13:46:58.319563 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 473/932] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:58 2022] GET /compute/v2.1/servers/90f44dc2-3872-4638-9bd9-0a587fb2edcd => generated 1503 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:46:59.084066 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-7f5387e6-a7f4-4a8e-b70e-e865a907a1c1 req-b06a713e-3db0-4607-bbf5-ec5bcfc877a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90f44dc2-3872-4638-9bd9-0a587fb2edcd", "name": "network-vif-deleted", "tag": "c096e153-d3b5-435f-85d7-52eef0231b06"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:46:59.096733 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-7f5387e6-a7f4-4a8e-b70e-e865a907a1c1 req-b06a713e-3db0-4607-bbf5-ec5bcfc877a2 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:59.097616 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-7f5387e6-a7f4-4a8e-b70e-e865a907a1c1 req-b06a713e-3db0-4607-bbf5-ec5bcfc877a2 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:59.115879 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-7f5387e6-a7f4-4a8e-b70e-e865a907a1c1 req-b06a713e-3db0-4607-bbf5-ec5bcfc877a2 service nova] Creating event network-vif-deleted:c096e153-d3b5-435f-85d7-52eef0231b06 for instance 90f44dc2-3872-4638-9bd9-0a587fb2edcd on hv-cinder-81558 Jun 23 13:46:59.122380 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-7f5387e6-a7f4-4a8e-b70e-e865a907a1c1 req-b06a713e-3db0-4607-bbf5-ec5bcfc877a2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045011 Jun 23 13:46:59.123504 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 460/933] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:46:59.335875 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-68cfc040-50cb-4a33-81af-b55ce28d6a74 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:46:59.336796 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-68cfc040-50cb-4a33-81af-b55ce28d6a74 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 90f44dc2-3872-4638-9bd9-0a587fb2edcd] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:46:59.343594 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-68cfc040-50cb-4a33-81af-b55ce28d6a74 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:59.344068 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-68cfc040-50cb-4a33-81af-b55ce28d6a74 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:59.345016 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-68cfc040-50cb-4a33-81af-b55ce28d6a74 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:59.345462 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-68cfc040-50cb-4a33-81af-b55ce28d6a74 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:59.386499 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-68cfc040-50cb-4a33-81af-b55ce28d6a74 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:46:59.386974 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-68cfc040-50cb-4a33-81af-b55ce28d6a74 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:46:59.388133 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.objects.instance [None req-68cfc040-50cb-4a33-81af-b55ce28d6a74 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lazy-loading 'fault' on Instance uuid 90f44dc2-3872-4638-9bd9-0a587fb2edcd {{(pid=134667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:46:59.437989 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-68cfc040-50cb-4a33-81af-b55ce28d6a74 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d6e0c983e14de0a3d7d352d061b3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b6044e9c2e44009b2e7f5ee43019ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:46:59.445809 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-68cfc040-50cb-4a33-81af-b55ce28d6a74 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] 10.222.0.26 "GET /compute/v2.1/servers/90f44dc2-3872-4638-9bd9-0a587fb2edcd" status: 200 len: 1303 microversion: 2.1 time: 0.113763 Jun 23 13:46:59.446624 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 474/934] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:46:59 2022] GET /compute/v2.1/servers/90f44dc2-3872-4638-9bd9-0a587fb2edcd => generated 1303 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:47:00.465178 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-52875171-c6f3-463d-bb70-b1fb0d983948 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:47:00.465883 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-52875171-c6f3-463d-bb70-b1fb0d983948 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 90f44dc2-3872-4638-9bd9-0a587fb2edcd] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:47:00.472845 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-52875171-c6f3-463d-bb70-b1fb0d983948 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:00.473204 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-52875171-c6f3-463d-bb70-b1fb0d983948 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:00.473976 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-52875171-c6f3-463d-bb70-b1fb0d983948 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:00.474407 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-52875171-c6f3-463d-bb70-b1fb0d983948 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:00.488326 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.wsgi [None req-52875171-c6f3-463d-bb70-b1fb0d983948 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] HTTP exception thrown: Instance 90f44dc2-3872-4638-9bd9-0a587fb2edcd could not be found. Jun 23 13:47:00.489986 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-52875171-c6f3-463d-bb70-b1fb0d983948 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Request method failure captured: Jun 23 13:47:00.489986 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: request: GET /compute/v2.1/servers/90f44dc2-3872-4638-9bd9-0a587fb2edcd HTTP/1.1 Jun 23 13:47:00.489986 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept: application/json Jun 23 13:47:00.489986 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept-Encoding: identity Jun 23 13:47:00.489986 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Connection: close Jun 23 13:47:00.489986 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Length: 0 Jun 23 13:47:00.489986 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Type: application/json Jun 23 13:47:00.489986 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Host: 10.222.0.26 Jun 23 13:47:00.489986 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Openstack-System-Scope: None Jun 23 13:47:00.489986 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: User-Agent: python-urllib3/1.26.9 Jun 23 13:47:00.489986 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Auth-Token: gAAAAABitG7EXXgVxrchB8PmONjOoTFrHpjTNcboxFsOi0-vliq3JvYYoD4rH5l1sJsoMrB8HuSe1oLn0ey0shsaSwDIaOtLSfmzW_r4NnxYLV8sBLXNPZZ2XLesg32kRQcr3txM0Z1jiaSfcwwO1b_US1TZzoTxdDIFZyho9cVtpCjaGhlCGd8 Jun 23 13:47:00.489986 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Id: None Jun 23 13:47:00.489986 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Name: None Jun 23 13:47:00.489986 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Identity-Status: Confirmed Jun 23 13:47:00.489986 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Is-Admin-Project: True Jun 23 13:47:00.489986 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Id: default Jun 23 13:47:00.489986 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Name: Default Jun 23 13:47:00.489986 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Id: c3b6044e9c2e44009b2e7f5ee43019ac Jun 23 13:47:00.489986 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Name: tempest-VolumesActionsTest-696905392 Jun 23 13:47:00.489986 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Role: member,reader Jun 23 13:47:00.489986 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Roles: member,reader Jun 23 13:47:00.491477 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c3b6044e9c2e44009b2e7f5ee43019ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3b6044e9c2e44009b2e7f5ee43019ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3b6044e9c2e44009b2e7f5ee43019ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c3b6044e9c2e44009b2e7f5ee43019ac", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:47:00.491477 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant: tempest-VolumesActionsTest-696905392 Jun 23 13:47:00.491477 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Id: c3b6044e9c2e44009b2e7f5ee43019ac Jun 23 13:47:00.491477 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Name: tempest-VolumesActionsTest-696905392 Jun 23 13:47:00.491477 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User: tempest-VolumesActionsTest-696905392-project Jun 23 13:47:00.491477 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Id: default Jun 23 13:47:00.491477 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Name: Default Jun 23 13:47:00.491477 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Id: 20d6e0c983e14de0a3d7d352d061b3ff Jun 23 13:47:00.491477 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Name: tempest-VolumesActionsTest-696905392-project Jun 23 13:47:00.491477 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: method: > Jun 23 13:47:00.491477 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: exception: Instance 90f44dc2-3872-4638-9bd9-0a587fb2edcd could not be found. Jun 23 13:47:00.491477 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: action_args: {'id': '90f44dc2-3872-4638-9bd9-0a587fb2edcd'} Jun 23 13:47:00.492939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:47:00.492939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:47:00.492939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:47:00.492939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:47:00.492939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:47:00.492939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:47:00.492939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:47:00.492939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:47:00.492939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:47:00.492939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:47:00.492939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90f44dc2-3872-4638-9bd9-0a587fb2edcd could not be found. Jun 23 13:47:00.492939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:47:00.492939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:47:00.492939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:47:00.492939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:47:00.492939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:47:00.492939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:47:00.492939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:47:00.492939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:47:00.492939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:47:00.494612 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:47:00.494612 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:47:00.494612 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:47:00.494612 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:47:00.494612 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:47:00.494612 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:47:00.494612 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:47:00.494612 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90f44dc2-3872-4638-9bd9-0a587fb2edcd could not be found. Jun 23 13:47:00.494612 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:47:00.494612 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:47:00.494612 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:47:00.494612 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:47:00.494612 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:47:00.494612 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:47:00.494612 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:47:00.494612 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:47:00.494612 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90f44dc2-3872-4638-9bd9-0a587fb2edcd could not be found. Jun 23 13:47:00.494612 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:47:00.496598 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-52875171-c6f3-463d-bb70-b1fb0d983948 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Returning 404 to user: Instance 90f44dc2-3872-4638-9bd9-0a587fb2edcd could not be found. {{(pid=134666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:47:00.496598 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-52875171-c6f3-463d-bb70-b1fb0d983948 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] 10.222.0.26 "GET /compute/v2.1/servers/90f44dc2-3872-4638-9bd9-0a587fb2edcd" status: 404 len: 111 microversion: 2.1 time: 0.031210 Jun 23 13:47:00.496598 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 461/935] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:47:00 2022] GET /compute/v2.1/servers/90f44dc2-3872-4638-9bd9-0a587fb2edcd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:47:00.606421 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-d33693ed-93f4-4d45-90e8-6bf6b28fa0f9 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1026751338", "imageRef": "dd7aacbf-3b3e-496e-967e-53d2a1b1f200", "flavorRef": "452", "networks": [{"uuid": "157e0a54-4e55-4a36-8828-e724b9ae8557"}]}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:47:00.662185 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.network.neutron [None req-d33693ed-93f4-4d45-90e8-6bf6b28fa0f9 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] validate_networks() for [('157e0a54-4e55-4a36-8828-e724b9ae8557', None, None, None, None, None)] {{(pid=134667) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 13:47:00.767953 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-423dde0a-cd43-423b-82ac-4da25928461a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Action: 'create', calling method: .version_select at 0x7fd7724ee550>, body: {"keypair": {"name": "tempest-keypair-1107468320", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHA9VwEv/t7cdeVRef49+imncdirwOL5JkKL/4sLOhJRehNQkSy81KI0vlWXrVoAeAhmY2kpCvGYAbspovWjJpvxIWO6AuenYO48DoesWJWlxbbyJTXte6t9mrys4nA4nQ=="}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:47:00.781906 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-423dde0a-cd43-423b-82ac-4da25928461a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Getting quotas for project f9d1fbb158dc4d63a7aeb04d115f7636. Resources: {'key_pairs'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:47:00.785925 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-423dde0a-cd43-423b-82ac-4da25928461a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Getting quotas for user 2754a81c57c249cfa1bc9f0eb08e4dac and project f9d1fbb158dc4d63a7aeb04d115f7636. Resources: {'key_pairs'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:47:00.808573 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-423dde0a-cd43-423b-82ac-4da25928461a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.159093 Jun 23 13:47:00.809167 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 462/936] 10.222.0.26 () {60 vars in 1158 bytes} [Thu Jun 23 13:47:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 13:47:01.019306 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-d33693ed-93f4-4d45-90e8-6bf6b28fa0f9 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Flavor limits 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 13:47:01.020873 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-d33693ed-93f4-4d45-90e8-6bf6b28fa0f9 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Image limits 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 13:47:01.021388 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-d33693ed-93f4-4d45-90e8-6bf6b28fa0f9 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Flavor pref 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 13:47:01.021798 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-d33693ed-93f4-4d45-90e8-6bf6b28fa0f9 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Image pref 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 13:47:01.022212 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-d33693ed-93f4-4d45-90e8-6bf6b28fa0f9 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 13:47:01.032498 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d33693ed-93f4-4d45-90e8-6bf6b28fa0f9 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:01.032800 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d33693ed-93f4-4d45-90e8-6bf6b28fa0f9 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:01.033812 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d33693ed-93f4-4d45-90e8-6bf6b28fa0f9 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:01.034245 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d33693ed-93f4-4d45-90e8-6bf6b28fa0f9 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:01.052072 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.quota [None req-d33693ed-93f4-4d45-90e8-6bf6b28fa0f9 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Getting quotas for project c3b6044e9c2e44009b2e7f5ee43019ac. Resources: {'ram', 'cores', 'instances'} {{(pid=134667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:47:01.056386 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.quota [None req-d33693ed-93f4-4d45-90e8-6bf6b28fa0f9 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Getting quotas for user 20d6e0c983e14de0a3d7d352d061b3ff and project c3b6044e9c2e44009b2e7f5ee43019ac. Resources: {'ram', 'cores', 'instances'} {{(pid=134667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:47:01.069458 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-d33693ed-93f4-4d45-90e8-6bf6b28fa0f9 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Going to run 1 instances... {{(pid=134667) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 13:47:01.071941 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-d33693ed-93f4-4d45-90e8-6bf6b28fa0f9 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 1b86774c-7a2d-4c01-b59c-d3ef1fe36878] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7aacbf-3b3e-496e-967e-53d2a1b1f200',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134667) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 13:47:01.135000 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-d33693ed-93f4-4d45-90e8-6bf6b28fa0f9 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533224 Jun 23 13:47:01.139518 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 475/937] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Jun 23 13:47:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 13:47:01.146552 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-4e210960-34e4-4a01-940c-33e16f0a2828 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:47:01.147210 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-4e210960-34e4-4a01-940c-33e16f0a2828 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 1b86774c-7a2d-4c01-b59c-d3ef1fe36878] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:47:01.215407 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-4e210960-34e4-4a01-940c-33e16f0a2828 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d6e0c983e14de0a3d7d352d061b3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b6044e9c2e44009b2e7f5ee43019ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:47:01.222055 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-4e210960-34e4-4a01-940c-33e16f0a2828 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] 10.222.0.26 "GET /compute/v2.1/servers/1b86774c-7a2d-4c01-b59c-d3ef1fe36878" status: 200 len: 1214 microversion: 2.1 time: 0.079248 Jun 23 13:47:01.222864 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 463/938] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:47:01 2022] GET /compute/v2.1/servers/1b86774c-7a2d-4c01-b59c-d3ef1fe36878 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:47:02.239968 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-3d8c91a3-f8e9-4178-ba38-7bfb41faf849 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:47:02.241820 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-3d8c91a3-f8e9-4178-ba38-7bfb41faf849 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 1b86774c-7a2d-4c01-b59c-d3ef1fe36878] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:47:02.249701 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3d8c91a3-f8e9-4178-ba38-7bfb41faf849 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:02.259406 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3d8c91a3-f8e9-4178-ba38-7bfb41faf849 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:02.260638 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3d8c91a3-f8e9-4178-ba38-7bfb41faf849 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:02.261350 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3d8c91a3-f8e9-4178-ba38-7bfb41faf849 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:02.296371 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-8c6b71d4-6313-41f1-a896-ea886ce50784 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-634279686", "imageRef": "dd7aacbf-3b3e-496e-967e-53d2a1b1f200", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b55fd257-6b00-49b3-a392-7cc3edf381f1"}], "security_groups": [{"name": "tempest-securitygroup--2090367399"}], "key_name": "tempest-keypair-1107468320", "user_data": "}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:47:02.377247 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-3d8c91a3-f8e9-4178-ba38-7bfb41faf849 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d6e0c983e14de0a3d7d352d061b3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b6044e9c2e44009b2e7f5ee43019ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:47:02.385728 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-3d8c91a3-f8e9-4178-ba38-7bfb41faf849 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] 10.222.0.26 "GET /compute/v2.1/servers/1b86774c-7a2d-4c01-b59c-d3ef1fe36878" status: 200 len: 1272 microversion: 2.1 time: 0.149960 Jun 23 13:47:02.386895 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 476/939] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:47:02 2022] GET /compute/v2.1/servers/1b86774c-7a2d-4c01-b59c-d3ef1fe36878 => generated 1272 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:47:02.439146 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.network.neutron [None req-8c6b71d4-6313-41f1-a896-ea886ce50784 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] validate_networks() for [('b55fd257-6b00-49b3-a392-7cc3edf381f1', None, None, None, None, None)] {{(pid=134666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 13:47:03.267408 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-8c6b71d4-6313-41f1-a896-ea886ce50784 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Flavor limits 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 13:47:03.267837 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-8c6b71d4-6313-41f1-a896-ea886ce50784 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Image limits 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 13:47:03.268307 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-8c6b71d4-6313-41f1-a896-ea886ce50784 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Flavor pref 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 13:47:03.268713 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-8c6b71d4-6313-41f1-a896-ea886ce50784 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Image pref 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 13:47:03.269121 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-8c6b71d4-6313-41f1-a896-ea886ce50784 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 13:47:03.278512 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8c6b71d4-6313-41f1-a896-ea886ce50784 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:03.278886 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8c6b71d4-6313-41f1-a896-ea886ce50784 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:03.279707 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8c6b71d4-6313-41f1-a896-ea886ce50784 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:03.280350 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8c6b71d4-6313-41f1-a896-ea886ce50784 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:03.301521 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-8c6b71d4-6313-41f1-a896-ea886ce50784 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Getting quotas for project f9d1fbb158dc4d63a7aeb04d115f7636. Resources: {'ram', 'cores', 'instances'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:47:03.306920 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-8c6b71d4-6313-41f1-a896-ea886ce50784 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Getting quotas for user 2754a81c57c249cfa1bc9f0eb08e4dac and project f9d1fbb158dc4d63a7aeb04d115f7636. Resources: {'ram', 'cores', 'instances'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:47:03.319130 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-8c6b71d4-6313-41f1-a896-ea886ce50784 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Going to run 1 instances... {{(pid=134666) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 13:47:03.321576 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-8c6b71d4-6313-41f1-a896-ea886ce50784 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7aacbf-3b3e-496e-967e-53d2a1b1f200',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 13:47:03.373952 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-8c6b71d4-6313-41f1-a896-ea886ce50784 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.087224 Jun 23 13:47:03.375631 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 464/940] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Jun 23 13:47:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 1089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 13:47:03.385476 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-fbc6cb7a-96f0-4c53-bed1-35d6e0aea72b tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:47:03.386344 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-fbc6cb7a-96f0-4c53-bed1-35d6e0aea72b tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:47:03.405114 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-67b6413b-ea33-46fb-a11c-1fe25bedb043 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:47:03.407923 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-67b6413b-ea33-46fb-a11c-1fe25bedb043 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 1b86774c-7a2d-4c01-b59c-d3ef1fe36878] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:47:03.416069 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-67b6413b-ea33-46fb-a11c-1fe25bedb043 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:03.416762 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-67b6413b-ea33-46fb-a11c-1fe25bedb043 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:03.417799 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-67b6413b-ea33-46fb-a11c-1fe25bedb043 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:03.419986 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-67b6413b-ea33-46fb-a11c-1fe25bedb043 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:03.448329 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-fbc6cb7a-96f0-4c53-bed1-35d6e0aea72b tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:47:03.457034 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-fbc6cb7a-96f0-4c53-bed1-35d6e0aea72b tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1237 microversion: 2.1 time: 0.073900 Jun 23 13:47:03.457965 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 477/941] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:47:03 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1237 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:47:03.634325 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-67b6413b-ea33-46fb-a11c-1fe25bedb043 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d6e0c983e14de0a3d7d352d061b3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b6044e9c2e44009b2e7f5ee43019ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:47:03.648518 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-67b6413b-ea33-46fb-a11c-1fe25bedb043 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] 10.222.0.26 "GET /compute/v2.1/servers/1b86774c-7a2d-4c01-b59c-d3ef1fe36878" status: 200 len: 1314 microversion: 2.1 time: 0.247438 Jun 23 13:47:03.650489 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 465/942] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:47:03 2022] GET /compute/v2.1/servers/1b86774c-7a2d-4c01-b59c-d3ef1fe36878 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:47:03.835148 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-93f2219f-fe74-4e3a-ab9e-61480a347144 req-ab8109df-9784-47fa-a4b4-905052c45095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b86774c-7a2d-4c01-b59c-d3ef1fe36878", "tag": "62681711-211d-4e21-8403-a3f1cca59f9a"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:47:03.849645 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-93f2219f-fe74-4e3a-ab9e-61480a347144 req-ab8109df-9784-47fa-a4b4-905052c45095 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:03.850364 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-93f2219f-fe74-4e3a-ab9e-61480a347144 req-ab8109df-9784-47fa-a4b4-905052c45095 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:03.870365 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-93f2219f-fe74-4e3a-ab9e-61480a347144 req-ab8109df-9784-47fa-a4b4-905052c45095 service nova] Creating event network-changed:62681711-211d-4e21-8403-a3f1cca59f9a for instance 1b86774c-7a2d-4c01-b59c-d3ef1fe36878 on hv-cinder-81558 Jun 23 13:47:03.875213 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-93f2219f-fe74-4e3a-ab9e-61480a347144 req-ab8109df-9784-47fa-a4b4-905052c45095 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044042 Jun 23 13:47:03.876425 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 478/943] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:47:04.479242 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-8dccaa35-5b7e-4c52-a26c-abe87f335ed8 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:47:04.479977 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-8dccaa35-5b7e-4c52-a26c-abe87f335ed8 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:47:04.487197 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8dccaa35-5b7e-4c52-a26c-abe87f335ed8 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:04.487689 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8dccaa35-5b7e-4c52-a26c-abe87f335ed8 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:04.488456 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8dccaa35-5b7e-4c52-a26c-abe87f335ed8 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:04.488900 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8dccaa35-5b7e-4c52-a26c-abe87f335ed8 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:04.551553 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-8dccaa35-5b7e-4c52-a26c-abe87f335ed8 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:47:04.559289 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-8dccaa35-5b7e-4c52-a26c-abe87f335ed8 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1289 microversion: 2.1 time: 0.087717 Jun 23 13:47:04.559858 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 466/944] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:47:04 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1289 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:47:04.670690 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-872795e1-4717-4748-999c-94c375f0df3b tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:47:04.671605 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-872795e1-4717-4748-999c-94c375f0df3b tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 1b86774c-7a2d-4c01-b59c-d3ef1fe36878] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:47:04.679728 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-872795e1-4717-4748-999c-94c375f0df3b tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:04.680276 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-872795e1-4717-4748-999c-94c375f0df3b tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:04.681271 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-872795e1-4717-4748-999c-94c375f0df3b tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:04.681819 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-872795e1-4717-4748-999c-94c375f0df3b tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:04.814464 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-872795e1-4717-4748-999c-94c375f0df3b tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d6e0c983e14de0a3d7d352d061b3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b6044e9c2e44009b2e7f5ee43019ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:47:04.818046 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:04.822464 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-872795e1-4717-4748-999c-94c375f0df3b tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] 10.222.0.26 "GET /compute/v2.1/servers/1b86774c-7a2d-4c01-b59c-d3ef1fe36878" status: 200 len: 1314 microversion: 2.1 time: 0.158615 Jun 23 13:47:04.823028 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 479/945] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:47:04 2022] GET /compute/v2.1/servers/1b86774c-7a2d-4c01-b59c-d3ef1fe36878 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:47:05.577522 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-41142260-3a23-4bef-a26c-9299248886fa tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:47:05.578353 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-41142260-3a23-4bef-a26c-9299248886fa tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:47:05.585745 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-41142260-3a23-4bef-a26c-9299248886fa tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:05.586320 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-41142260-3a23-4bef-a26c-9299248886fa tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:05.587184 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-41142260-3a23-4bef-a26c-9299248886fa tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:05.587745 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-41142260-3a23-4bef-a26c-9299248886fa tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:05.655249 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-41142260-3a23-4bef-a26c-9299248886fa tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:47:05.663082 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-41142260-3a23-4bef-a26c-9299248886fa tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1295 microversion: 2.1 time: 0.090174 Jun 23 13:47:05.663777 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 467/946] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:47:05 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1295 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:47:05.845572 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-3ebfca9e-9be4-4576-a4a4-0280b52bab20 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:47:05.846178 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-3ebfca9e-9be4-4576-a4a4-0280b52bab20 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 1b86774c-7a2d-4c01-b59c-d3ef1fe36878] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:47:05.853846 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3ebfca9e-9be4-4576-a4a4-0280b52bab20 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:05.854540 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3ebfca9e-9be4-4576-a4a4-0280b52bab20 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:05.855317 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3ebfca9e-9be4-4576-a4a4-0280b52bab20 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:05.855808 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3ebfca9e-9be4-4576-a4a4-0280b52bab20 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:06.007963 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-3ebfca9e-9be4-4576-a4a4-0280b52bab20 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d6e0c983e14de0a3d7d352d061b3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b6044e9c2e44009b2e7f5ee43019ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:47:06.016512 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-3ebfca9e-9be4-4576-a4a4-0280b52bab20 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] 10.222.0.26 "GET /compute/v2.1/servers/1b86774c-7a2d-4c01-b59c-d3ef1fe36878" status: 200 len: 1314 microversion: 2.1 time: 0.175349 Jun 23 13:47:06.017164 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 480/947] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:47:05 2022] GET /compute/v2.1/servers/1b86774c-7a2d-4c01-b59c-d3ef1fe36878 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:47:06.680672 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-2733ca47-2d11-47ac-9f82-704dd20cb12a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:47:06.681484 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-2733ca47-2d11-47ac-9f82-704dd20cb12a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:47:06.688884 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2733ca47-2d11-47ac-9f82-704dd20cb12a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:06.689354 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2733ca47-2d11-47ac-9f82-704dd20cb12a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:06.690287 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2733ca47-2d11-47ac-9f82-704dd20cb12a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:06.690732 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2733ca47-2d11-47ac-9f82-704dd20cb12a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:06.827767 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-2733ca47-2d11-47ac-9f82-704dd20cb12a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:47:06.835963 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-2733ca47-2d11-47ac-9f82-704dd20cb12a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1363 microversion: 2.1 time: 0.159199 Jun 23 13:47:06.836566 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 468/948] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:47:06 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:47:07.033761 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-8f4c54f1-3ade-4ea8-b041-14e662b33c46 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:47:07.034495 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-8f4c54f1-3ade-4ea8-b041-14e662b33c46 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 1b86774c-7a2d-4c01-b59c-d3ef1fe36878] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:47:07.046523 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8f4c54f1-3ade-4ea8-b041-14e662b33c46 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:07.046982 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8f4c54f1-3ade-4ea8-b041-14e662b33c46 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:07.047795 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8f4c54f1-3ade-4ea8-b041-14e662b33c46 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:07.048232 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8f4c54f1-3ade-4ea8-b041-14e662b33c46 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:07.184404 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-8f4c54f1-3ade-4ea8-b041-14e662b33c46 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d6e0c983e14de0a3d7d352d061b3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b6044e9c2e44009b2e7f5ee43019ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:47:07.194030 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-8f4c54f1-3ade-4ea8-b041-14e662b33c46 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] 10.222.0.26 "GET /compute/v2.1/servers/1b86774c-7a2d-4c01-b59c-d3ef1fe36878" status: 200 len: 1314 microversion: 2.1 time: 0.164239 Jun 23 13:47:07.195666 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 481/949] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:47:07 2022] GET /compute/v2.1/servers/1b86774c-7a2d-4c01-b59c-d3ef1fe36878 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:47:07.197162 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-2c2f78ca-5fdb-4ea9-9b37-43b2aaa44de8 req-01da2585-33a4-423b-9bc3-b2cab99a41f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a45e14a5-376a-40fb-8ea0-934aa3de116a", "tag": "05ad5662-9e88-4d0d-aecc-58d0f3be244c"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:47:07.216812 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-2c2f78ca-5fdb-4ea9-9b37-43b2aaa44de8 req-01da2585-33a4-423b-9bc3-b2cab99a41f1 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:07.217498 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-2c2f78ca-5fdb-4ea9-9b37-43b2aaa44de8 req-01da2585-33a4-423b-9bc3-b2cab99a41f1 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:07.380168 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-2c2f78ca-5fdb-4ea9-9b37-43b2aaa44de8 req-01da2585-33a4-423b-9bc3-b2cab99a41f1 service nova] Creating event network-changed:05ad5662-9e88-4d0d-aecc-58d0f3be244c for instance a45e14a5-376a-40fb-8ea0-934aa3de116a on hv-cinder-81558 Jun 23 13:47:07.385212 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-2c2f78ca-5fdb-4ea9-9b37-43b2aaa44de8 req-01da2585-33a4-423b-9bc3-b2cab99a41f1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192046 Jun 23 13:47:07.385841 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 469/950] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:47:07.673938 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-0cee628b-d866-4303-b86e-8c3b4f90a413 req-4a3fe19d-8772-4334-ad72-74515e72f123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b86774c-7a2d-4c01-b59c-d3ef1fe36878", "name": "network-vif-plugged", "status": "completed", "tag": "62681711-211d-4e21-8403-a3f1cca59f9a"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:47:07.682240 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-0cee628b-d866-4303-b86e-8c3b4f90a413 req-4a3fe19d-8772-4334-ad72-74515e72f123 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:07.682840 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-0cee628b-d866-4303-b86e-8c3b4f90a413 req-4a3fe19d-8772-4334-ad72-74515e72f123 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:07.695640 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-0cee628b-d866-4303-b86e-8c3b4f90a413 req-4a3fe19d-8772-4334-ad72-74515e72f123 service nova] Creating event network-vif-plugged:62681711-211d-4e21-8403-a3f1cca59f9a for instance 1b86774c-7a2d-4c01-b59c-d3ef1fe36878 on hv-cinder-81558 Jun 23 13:47:07.700690 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-0cee628b-d866-4303-b86e-8c3b4f90a413 req-4a3fe19d-8772-4334-ad72-74515e72f123 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030804 Jun 23 13:47:07.701456 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 482/951] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:47:07.858461 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-6a66f41d-fec0-4127-8e3b-b7f9dc52c89d tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:47:07.859658 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-6a66f41d-fec0-4127-8e3b-b7f9dc52c89d tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:47:07.870090 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6a66f41d-fec0-4127-8e3b-b7f9dc52c89d tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:07.870873 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6a66f41d-fec0-4127-8e3b-b7f9dc52c89d tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:07.872187 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6a66f41d-fec0-4127-8e3b-b7f9dc52c89d tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:07.872919 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6a66f41d-fec0-4127-8e3b-b7f9dc52c89d tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:08.018255 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-6a66f41d-fec0-4127-8e3b-b7f9dc52c89d tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:47:08.026302 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-6a66f41d-fec0-4127-8e3b-b7f9dc52c89d tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1363 microversion: 2.1 time: 0.175832 Jun 23 13:47:08.026898 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 470/952] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:47:07 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:47:08.215778 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-1cbbc0f9-1bc7-436f-bb8b-cd31c4ef4701 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:47:08.216477 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-1cbbc0f9-1bc7-436f-bb8b-cd31c4ef4701 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 1b86774c-7a2d-4c01-b59c-d3ef1fe36878] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:47:08.223620 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1cbbc0f9-1bc7-436f-bb8b-cd31c4ef4701 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:08.224066 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1cbbc0f9-1bc7-436f-bb8b-cd31c4ef4701 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:08.224823 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1cbbc0f9-1bc7-436f-bb8b-cd31c4ef4701 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:08.225255 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-1cbbc0f9-1bc7-436f-bb8b-cd31c4ef4701 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:08.357777 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-1cbbc0f9-1bc7-436f-bb8b-cd31c4ef4701 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d6e0c983e14de0a3d7d352d061b3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b6044e9c2e44009b2e7f5ee43019ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:47:08.365362 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-1cbbc0f9-1bc7-436f-bb8b-cd31c4ef4701 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] 10.222.0.26 "GET /compute/v2.1/servers/1b86774c-7a2d-4c01-b59c-d3ef1fe36878" status: 200 len: 1314 microversion: 2.1 time: 0.156103 Jun 23 13:47:08.365859 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 483/953] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:47:08 2022] GET /compute/v2.1/servers/1b86774c-7a2d-4c01-b59c-d3ef1fe36878 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:47:09.043435 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-513ff073-c89c-43da-9731-859a655a9e7b tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:47:09.044023 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-513ff073-c89c-43da-9731-859a655a9e7b tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:47:09.051627 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-513ff073-c89c-43da-9731-859a655a9e7b tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:09.052118 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-513ff073-c89c-43da-9731-859a655a9e7b tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:09.052889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-513ff073-c89c-43da-9731-859a655a9e7b tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:09.053363 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-513ff073-c89c-43da-9731-859a655a9e7b tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:09.072080 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:SELECT=100 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:09.182543 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-513ff073-c89c-43da-9731-859a655a9e7b tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:47:09.190683 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-513ff073-c89c-43da-9731-859a655a9e7b tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1363 microversion: 2.1 time: 0.151229 Jun 23 13:47:09.191227 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 471/954] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:47:09 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:47:09.382598 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-ce3c7805-1e3d-4282-b643-1eb46fde8353 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:47:09.383224 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-ce3c7805-1e3d-4282-b643-1eb46fde8353 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 1b86774c-7a2d-4c01-b59c-d3ef1fe36878] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:47:09.390275 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ce3c7805-1e3d-4282-b643-1eb46fde8353 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:09.390735 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ce3c7805-1e3d-4282-b643-1eb46fde8353 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:09.391535 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ce3c7805-1e3d-4282-b643-1eb46fde8353 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:09.391979 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ce3c7805-1e3d-4282-b643-1eb46fde8353 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:09.527172 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-ce3c7805-1e3d-4282-b643-1eb46fde8353 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d6e0c983e14de0a3d7d352d061b3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b6044e9c2e44009b2e7f5ee43019ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:47:09.535237 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-ce3c7805-1e3d-4282-b643-1eb46fde8353 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] 10.222.0.26 "GET /compute/v2.1/servers/1b86774c-7a2d-4c01-b59c-d3ef1fe36878" status: 200 len: 1314 microversion: 2.1 time: 0.156710 Jun 23 13:47:09.535886 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 484/955] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:47:09 2022] GET /compute/v2.1/servers/1b86774c-7a2d-4c01-b59c-d3ef1fe36878 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:47:10.213342 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-54179ab1-ad48-4748-8e90-3a7f03205171 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:47:10.214161 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-54179ab1-ad48-4748-8e90-3a7f03205171 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:47:10.220921 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-54179ab1-ad48-4748-8e90-3a7f03205171 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:10.222294 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-54179ab1-ad48-4748-8e90-3a7f03205171 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:10.223065 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-54179ab1-ad48-4748-8e90-3a7f03205171 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:10.223925 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-54179ab1-ad48-4748-8e90-3a7f03205171 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:10.362310 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-54179ab1-ad48-4748-8e90-3a7f03205171 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:47:10.373520 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-54179ab1-ad48-4748-8e90-3a7f03205171 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1363 microversion: 2.1 time: 0.163980 Jun 23 13:47:10.374296 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 472/956] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:47:10 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:47:10.556163 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-74164614-39a4-4d5c-b6c5-8d901e2a8eb2 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:47:10.557157 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-74164614-39a4-4d5c-b6c5-8d901e2a8eb2 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 1b86774c-7a2d-4c01-b59c-d3ef1fe36878] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:47:10.568039 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-74164614-39a4-4d5c-b6c5-8d901e2a8eb2 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:10.568783 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-74164614-39a4-4d5c-b6c5-8d901e2a8eb2 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:10.570069 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-74164614-39a4-4d5c-b6c5-8d901e2a8eb2 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:10.570779 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-74164614-39a4-4d5c-b6c5-8d901e2a8eb2 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:10.709411 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-74164614-39a4-4d5c-b6c5-8d901e2a8eb2 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d6e0c983e14de0a3d7d352d061b3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b6044e9c2e44009b2e7f5ee43019ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:47:10.717063 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-74164614-39a4-4d5c-b6c5-8d901e2a8eb2 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] 10.222.0.26 "GET /compute/v2.1/servers/1b86774c-7a2d-4c01-b59c-d3ef1fe36878" status: 200 len: 1499 microversion: 2.1 time: 0.167852 Jun 23 13:47:10.717639 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 485/957] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:47:10 2022] GET /compute/v2.1/servers/1b86774c-7a2d-4c01-b59c-d3ef1fe36878 => generated 1499 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:47:11.185046 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-9c8fe50f-6b18-4f5c-b9c0-f0d50c52bc07 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:47:11.185508 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-9c8fe50f-6b18-4f5c-b9c0-f0d50c52bc07 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 1b86774c-7a2d-4c01-b59c-d3ef1fe36878] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:47:11.188509 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:11.192275 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9c8fe50f-6b18-4f5c-b9c0-f0d50c52bc07 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:11.192859 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9c8fe50f-6b18-4f5c-b9c0-f0d50c52bc07 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:11.193621 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9c8fe50f-6b18-4f5c-b9c0-f0d50c52bc07 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:11.194062 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9c8fe50f-6b18-4f5c-b9c0-f0d50c52bc07 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:11.220514 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-9c8fe50f-6b18-4f5c-b9c0-f0d50c52bc07 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 1b86774c-7a2d-4c01-b59c-d3ef1fe36878] Going to try to terminate instance {{(pid=134666) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 13:47:11.299560 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-9c8fe50f-6b18-4f5c-b9c0-f0d50c52bc07 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1b86774c-7a2d-4c01-b59c-d3ef1fe36878" status: 204 len: 0 microversion: 2.1 time: 0.117726 Jun 23 13:47:11.300341 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 473/958] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Jun 23 13:47:11 2022] DELETE /compute/v2.1/servers/1b86774c-7a2d-4c01-b59c-d3ef1fe36878 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 13:47:11.309090 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-9d714cb1-afc1-4c00-8fd2-af35a262ea15 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:47:11.309697 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-9d714cb1-afc1-4c00-8fd2-af35a262ea15 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 1b86774c-7a2d-4c01-b59c-d3ef1fe36878] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:47:11.311716 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell0:SELECT=2 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:11.317675 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9d714cb1-afc1-4c00-8fd2-af35a262ea15 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:11.318122 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9d714cb1-afc1-4c00-8fd2-af35a262ea15 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:11.318875 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9d714cb1-afc1-4c00-8fd2-af35a262ea15 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:11.319304 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9d714cb1-afc1-4c00-8fd2-af35a262ea15 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:11.394894 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-60f6b75a-b383-4fd9-901e-764173ceaf3d tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:47:11.396223 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-60f6b75a-b383-4fd9-901e-764173ceaf3d tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:47:11.402185 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-60f6b75a-b383-4fd9-901e-764173ceaf3d tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:11.402652 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-60f6b75a-b383-4fd9-901e-764173ceaf3d tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:11.403445 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-60f6b75a-b383-4fd9-901e-764173ceaf3d tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:11.403882 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-60f6b75a-b383-4fd9-901e-764173ceaf3d tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:11.461428 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-9d714cb1-afc1-4c00-8fd2-af35a262ea15 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d6e0c983e14de0a3d7d352d061b3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b6044e9c2e44009b2e7f5ee43019ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:47:11.469185 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-9d714cb1-afc1-4c00-8fd2-af35a262ea15 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] 10.222.0.26 "GET /compute/v2.1/servers/1b86774c-7a2d-4c01-b59c-d3ef1fe36878" status: 200 len: 1505 microversion: 2.1 time: 0.164429 Jun 23 13:47:11.479541 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 486/959] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:47:11 2022] GET /compute/v2.1/servers/1b86774c-7a2d-4c01-b59c-d3ef1fe36878 => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:47:11.550961 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-60f6b75a-b383-4fd9-901e-764173ceaf3d tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:47:11.558814 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-60f6b75a-b383-4fd9-901e-764173ceaf3d tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1363 microversion: 2.1 time: 0.168392 Jun 23 13:47:11.559418 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 474/960] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:47:11 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:47:11.706826 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-b893320c-641e-4133-8c46-7c530c77ce03 req-6ceb1772-1141-402c-84b3-bad48e6ad234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a45e14a5-376a-40fb-8ea0-934aa3de116a", "name": "network-vif-plugged", "status": "completed", "tag": "05ad5662-9e88-4d0d-aecc-58d0f3be244c"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:47:11.715706 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-b893320c-641e-4133-8c46-7c530c77ce03 req-6ceb1772-1141-402c-84b3-bad48e6ad234 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:11.716086 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-b893320c-641e-4133-8c46-7c530c77ce03 req-6ceb1772-1141-402c-84b3-bad48e6ad234 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:11.727356 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-b893320c-641e-4133-8c46-7c530c77ce03 req-6ceb1772-1141-402c-84b3-bad48e6ad234 service nova] Creating event network-vif-plugged:05ad5662-9e88-4d0d-aecc-58d0f3be244c for instance a45e14a5-376a-40fb-8ea0-934aa3de116a on hv-cinder-81558 Jun 23 13:47:11.732288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-b893320c-641e-4133-8c46-7c530c77ce03 req-6ceb1772-1141-402c-84b3-bad48e6ad234 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029514 Jun 23 13:47:11.732905 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 487/961] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:47:12.487109 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-4801896e-2f8c-4d0b-a7c5-99f5800bb042 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:47:12.488043 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-4801896e-2f8c-4d0b-a7c5-99f5800bb042 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 1b86774c-7a2d-4c01-b59c-d3ef1fe36878] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:47:12.498421 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4801896e-2f8c-4d0b-a7c5-99f5800bb042 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:12.499162 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4801896e-2f8c-4d0b-a7c5-99f5800bb042 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:12.500413 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4801896e-2f8c-4d0b-a7c5-99f5800bb042 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:12.501068 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-4801896e-2f8c-4d0b-a7c5-99f5800bb042 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:12.576497 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-bdf0efbc-3e5d-4b2e-94bf-a27d72667839 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:47:12.578160 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-bdf0efbc-3e5d-4b2e-94bf-a27d72667839 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:47:12.585347 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bdf0efbc-3e5d-4b2e-94bf-a27d72667839 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:12.585984 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bdf0efbc-3e5d-4b2e-94bf-a27d72667839 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:12.586543 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bdf0efbc-3e5d-4b2e-94bf-a27d72667839 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:12.586979 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bdf0efbc-3e5d-4b2e-94bf-a27d72667839 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:12.676406 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-4801896e-2f8c-4d0b-a7c5-99f5800bb042 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d6e0c983e14de0a3d7d352d061b3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b6044e9c2e44009b2e7f5ee43019ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:47:12.684665 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-4801896e-2f8c-4d0b-a7c5-99f5800bb042 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] 10.222.0.26 "GET /compute/v2.1/servers/1b86774c-7a2d-4c01-b59c-d3ef1fe36878" status: 200 len: 1505 microversion: 2.1 time: 0.202266 Jun 23 13:47:12.685447 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 475/962] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:47:12 2022] GET /compute/v2.1/servers/1b86774c-7a2d-4c01-b59c-d3ef1fe36878 => generated 1505 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:47:12.742854 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-bdf0efbc-3e5d-4b2e-94bf-a27d72667839 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:47:12.750678 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-bdf0efbc-3e5d-4b2e-94bf-a27d72667839 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1363 microversion: 2.1 time: 0.179571 Jun 23 13:47:12.751243 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 488/963] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:47:12 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:47:13.488774 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-bf6222c9-14c3-4acf-b09e-0aacc9c83c69 req-8491bd4f-1e4f-4197-b3c8-a1bb10295245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b86774c-7a2d-4c01-b59c-d3ef1fe36878", "name": "network-vif-deleted", "tag": "62681711-211d-4e21-8403-a3f1cca59f9a"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:47:13.492266 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell0:SELECT=2 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:13.492922 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell0:SELECT=12 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:13.499256 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-bf6222c9-14c3-4acf-b09e-0aacc9c83c69 req-8491bd4f-1e4f-4197-b3c8-a1bb10295245 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:13.499727 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-bf6222c9-14c3-4acf-b09e-0aacc9c83c69 req-8491bd4f-1e4f-4197-b3c8-a1bb10295245 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:13.511424 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-bf6222c9-14c3-4acf-b09e-0aacc9c83c69 req-8491bd4f-1e4f-4197-b3c8-a1bb10295245 service nova] Creating event network-vif-deleted:62681711-211d-4e21-8403-a3f1cca59f9a for instance 1b86774c-7a2d-4c01-b59c-d3ef1fe36878 on hv-cinder-81558 Jun 23 13:47:13.516298 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-bf6222c9-14c3-4acf-b09e-0aacc9c83c69 req-8491bd4f-1e4f-4197-b3c8-a1bb10295245 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031257 Jun 23 13:47:13.516910 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 476/964] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:47:13.703658 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-0b778e22-e1b5-4ff9-9047-5b4750e9009c tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:47:13.704367 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-0b778e22-e1b5-4ff9-9047-5b4750e9009c tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 1b86774c-7a2d-4c01-b59c-d3ef1fe36878] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:47:13.707738 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell0:SELECT=8 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:13.714594 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0b778e22-e1b5-4ff9-9047-5b4750e9009c tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:13.715033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0b778e22-e1b5-4ff9-9047-5b4750e9009c tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:13.715825 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0b778e22-e1b5-4ff9-9047-5b4750e9009c tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:13.716259 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0b778e22-e1b5-4ff9-9047-5b4750e9009c tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:13.747882 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0b778e22-e1b5-4ff9-9047-5b4750e9009c tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:13.748416 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0b778e22-e1b5-4ff9-9047-5b4750e9009c tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:13.748769 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.objects.instance [None req-0b778e22-e1b5-4ff9-9047-5b4750e9009c tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lazy-loading 'fault' on Instance uuid 1b86774c-7a2d-4c01-b59c-d3ef1fe36878 {{(pid=134667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:47:13.768833 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c8023e8d-fe8d-47fc-8ae9-0cf024407c7a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:47:13.769547 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-c8023e8d-fe8d-47fc-8ae9-0cf024407c7a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:47:13.775834 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c8023e8d-fe8d-47fc-8ae9-0cf024407c7a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:13.776330 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c8023e8d-fe8d-47fc-8ae9-0cf024407c7a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:13.777091 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c8023e8d-fe8d-47fc-8ae9-0cf024407c7a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:13.777588 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c8023e8d-fe8d-47fc-8ae9-0cf024407c7a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:13.789965 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-0b778e22-e1b5-4ff9-9047-5b4750e9009c tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20d6e0c983e14de0a3d7d352d061b3ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3b6044e9c2e44009b2e7f5ee43019ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:47:13.798080 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-0b778e22-e1b5-4ff9-9047-5b4750e9009c tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] 10.222.0.26 "GET /compute/v2.1/servers/1b86774c-7a2d-4c01-b59c-d3ef1fe36878" status: 200 len: 1304 microversion: 2.1 time: 0.099209 Jun 23 13:47:13.798717 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 489/965] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:47:13 2022] GET /compute/v2.1/servers/1b86774c-7a2d-4c01-b59c-d3ef1fe36878 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:47:13.920968 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-c8023e8d-fe8d-47fc-8ae9-0cf024407c7a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:47:13.931425 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-c8023e8d-fe8d-47fc-8ae9-0cf024407c7a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1363 microversion: 2.1 time: 0.167473 Jun 23 13:47:13.931914 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 477/966] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:47:13 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:47:14.819320 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-2b853d87-5121-4ab0-908c-314fe619a9d7 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:47:14.820334 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-2b853d87-5121-4ab0-908c-314fe619a9d7 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] [instance: 1b86774c-7a2d-4c01-b59c-d3ef1fe36878] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:47:14.823652 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:14.829269 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2b853d87-5121-4ab0-908c-314fe619a9d7 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:14.829716 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2b853d87-5121-4ab0-908c-314fe619a9d7 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:14.830800 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2b853d87-5121-4ab0-908c-314fe619a9d7 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:14.831232 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2b853d87-5121-4ab0-908c-314fe619a9d7 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:14.846588 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.wsgi [None req-2b853d87-5121-4ab0-908c-314fe619a9d7 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] HTTP exception thrown: Instance 1b86774c-7a2d-4c01-b59c-d3ef1fe36878 could not be found. Jun 23 13:47:14.848274 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-2b853d87-5121-4ab0-908c-314fe619a9d7 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Request method failure captured: Jun 23 13:47:14.848274 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: GET /compute/v2.1/servers/1b86774c-7a2d-4c01-b59c-d3ef1fe36878 HTTP/1.1 Jun 23 13:47:14.848274 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:47:14.848274 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:47:14.848274 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:47:14.848274 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 0 Jun 23 13:47:14.848274 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:47:14.848274 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:47:14.848274 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:47:14.848274 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:47:14.848274 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitG7EXXgVxrchB8PmONjOoTFrHpjTNcboxFsOi0-vliq3JvYYoD4rH5l1sJsoMrB8HuSe1oLn0ey0shsaSwDIaOtLSfmzW_r4NnxYLV8sBLXNPZZ2XLesg32kRQcr3txM0Z1jiaSfcwwO1b_US1TZzoTxdDIFZyho9cVtpCjaGhlCGd8 Jun 23 13:47:14.848274 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:47:14.848274 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:47:14.848274 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:47:14.848274 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:47:14.848274 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:47:14.848274 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:47:14.848274 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: c3b6044e9c2e44009b2e7f5ee43019ac Jun 23 13:47:14.848274 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-VolumesActionsTest-696905392 Jun 23 13:47:14.848274 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:47:14.848274 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:47:14.849847 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c3b6044e9c2e44009b2e7f5ee43019ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3b6044e9c2e44009b2e7f5ee43019ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3b6044e9c2e44009b2e7f5ee43019ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c3b6044e9c2e44009b2e7f5ee43019ac", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:47:14.849847 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-VolumesActionsTest-696905392 Jun 23 13:47:14.849847 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: c3b6044e9c2e44009b2e7f5ee43019ac Jun 23 13:47:14.849847 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-VolumesActionsTest-696905392 Jun 23 13:47:14.849847 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-VolumesActionsTest-696905392-project Jun 23 13:47:14.849847 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:47:14.849847 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:47:14.849847 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: 20d6e0c983e14de0a3d7d352d061b3ff Jun 23 13:47:14.849847 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-VolumesActionsTest-696905392-project Jun 23 13:47:14.849847 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: > Jun 23 13:47:14.849847 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Instance 1b86774c-7a2d-4c01-b59c-d3ef1fe36878 could not be found. Jun 23 13:47:14.849847 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'id': '1b86774c-7a2d-4c01-b59c-d3ef1fe36878'} Jun 23 13:47:14.850669 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:47:14.850669 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:47:14.850669 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:47:14.850669 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:47:14.850669 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:47:14.850669 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:47:14.850669 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:47:14.850669 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:47:14.850669 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:47:14.850669 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:47:14.850669 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b86774c-7a2d-4c01-b59c-d3ef1fe36878 could not be found. Jun 23 13:47:14.850669 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:47:14.850669 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:47:14.850669 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:47:14.850669 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:47:14.850669 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:47:14.850669 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:47:14.850669 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:47:14.850669 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:47:14.850669 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:47:14.852263 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:47:14.852263 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:47:14.852263 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:47:14.852263 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:47:14.852263 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:47:14.852263 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:47:14.852263 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:47:14.852263 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b86774c-7a2d-4c01-b59c-d3ef1fe36878 could not be found. Jun 23 13:47:14.852263 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:47:14.852263 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:47:14.852263 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:47:14.852263 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:47:14.852263 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:47:14.852263 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:47:14.852263 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:47:14.852263 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:47:14.852263 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b86774c-7a2d-4c01-b59c-d3ef1fe36878 could not be found. Jun 23 13:47:14.852263 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:47:14.853917 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-2b853d87-5121-4ab0-908c-314fe619a9d7 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] Returning 404 to user: Instance 1b86774c-7a2d-4c01-b59c-d3ef1fe36878 could not be found. {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:47:14.853917 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-2b853d87-5121-4ab0-908c-314fe619a9d7 tempest-VolumesActionsTest-696905392 tempest-VolumesActionsTest-696905392-project] 10.222.0.26 "GET /compute/v2.1/servers/1b86774c-7a2d-4c01-b59c-d3ef1fe36878" status: 404 len: 111 microversion: 2.1 time: 0.036776 Jun 23 13:47:14.853917 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 490/967] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:47:14 2022] GET /compute/v2.1/servers/1b86774c-7a2d-4c01-b59c-d3ef1fe36878 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:47:14.950021 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c3dca382-c32d-4fcd-b163-80c3b2cacefe tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:47:14.950729 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-c3dca382-c32d-4fcd-b163-80c3b2cacefe tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:47:14.957404 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c3dca382-c32d-4fcd-b163-80c3b2cacefe tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:14.957919 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c3dca382-c32d-4fcd-b163-80c3b2cacefe tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:14.958760 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c3dca382-c32d-4fcd-b163-80c3b2cacefe tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:14.959246 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c3dca382-c32d-4fcd-b163-80c3b2cacefe tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:15.099551 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-c3dca382-c32d-4fcd-b163-80c3b2cacefe tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:47:15.107205 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-c3dca382-c32d-4fcd-b163-80c3b2cacefe tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1549 microversion: 2.1 time: 0.161339 Jun 23 13:47:15.108030 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 478/968] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:47:14 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:47:15.123822 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-37778071-f3d7-47dd-b9cf-6a125b13ae75 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:47:15.124321 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-37778071-f3d7-47dd-b9cf-6a125b13ae75 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:47:15.130248 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-37778071-f3d7-47dd-b9cf-6a125b13ae75 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:15.130698 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-37778071-f3d7-47dd-b9cf-6a125b13ae75 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:15.131528 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-37778071-f3d7-47dd-b9cf-6a125b13ae75 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:15.131952 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-37778071-f3d7-47dd-b9cf-6a125b13ae75 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:15.212625 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-37778071-f3d7-47dd-b9cf-6a125b13ae75 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092762 Jun 23 13:47:15.213261 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 491/969] 10.222.0.26 () {58 vars in 1274 bytes} [Thu Jun 23 13:47:15 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:47:16.211278 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-90ecf64f-cccf-4565-ae1f-3ee3c964c18d req-8bca28b7-f4fc-43d8-be3d-82c25bd7144b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a45e14a5-376a-40fb-8ea0-934aa3de116a", "tag": "05ad5662-9e88-4d0d-aecc-58d0f3be244c"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:47:16.219985 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-90ecf64f-cccf-4565-ae1f-3ee3c964c18d req-8bca28b7-f4fc-43d8-be3d-82c25bd7144b service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:16.220429 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-90ecf64f-cccf-4565-ae1f-3ee3c964c18d req-8bca28b7-f4fc-43d8-be3d-82c25bd7144b service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:16.231887 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-90ecf64f-cccf-4565-ae1f-3ee3c964c18d req-8bca28b7-f4fc-43d8-be3d-82c25bd7144b service nova] Creating event network-changed:05ad5662-9e88-4d0d-aecc-58d0f3be244c for instance a45e14a5-376a-40fb-8ea0-934aa3de116a on hv-cinder-81558 Jun 23 13:47:16.236919 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-90ecf64f-cccf-4565-ae1f-3ee3c964c18d req-8bca28b7-f4fc-43d8-be3d-82c25bd7144b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029277 Jun 23 13:47:16.237540 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 479/970] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:47:41.074555 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 13:47:41.075185 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Thu Jun 23 13:47:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 13:47:52.373119 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_api:SELECT=3 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:52.373935 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=60 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:47:52.378975 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-3dbc98d3-e105-4aef-8915-812ed6afcd84 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:47:52.379576 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-3dbc98d3-e105-4aef-8915-812ed6afcd84 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:47:52.387189 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3dbc98d3-e105-4aef-8915-812ed6afcd84 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:52.387658 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3dbc98d3-e105-4aef-8915-812ed6afcd84 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:52.388410 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3dbc98d3-e105-4aef-8915-812ed6afcd84 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:47:52.388841 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3dbc98d3-e105-4aef-8915-812ed6afcd84 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:47:52.412164 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-3dbc98d3-e105-4aef-8915-812ed6afcd84 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a/ips" status: 200 len: 145 microversion: 2.1 time: 0.040973 Jun 23 13:47:52.412715 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 492/971] 10.222.0.26 () {58 vars in 1247 bytes} [Thu Jun 23 13:47:52 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:48:00.841854 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:00.842596 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:00.846915 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-2a32f430-d230-4540-9781-b01979657e10 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9fe8ba69-69a5-4e41-8e42-a0b0e992e7aa"}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:48:00.848086 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-2a32f430-d230-4540-9781-b01979657e10 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:00.855778 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2a32f430-d230-4540-9781-b01979657e10 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:00.856275 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2a32f430-d230-4540-9781-b01979657e10 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:00.857309 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2a32f430-d230-4540-9781-b01979657e10 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:00.857752 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-2a32f430-d230-4540-9781-b01979657e10 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:01.106136 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-2a32f430-d230-4540-9781-b01979657e10 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "POST /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265852 Jun 23 13:48:01.107228 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 480/972] 10.222.0.26 () {60 vars in 1322 bytes} [Thu Jun 23 13:48:00 2022] POST /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:48:03.548369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-57735b57-2503-4614-8649-02521c4e8a08 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1972962102", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1938430720", "security_groups": [{"name": "tempest-secgroup-smoke-6844620"}], "block_device_mapping_v2": [{"uuid": "22c90307-b66b-4e3d-8862-5d5b0491d80a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "bb715288-0a54-4ca5-85b6-5a7823648ca0"}]}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:48:03.557563 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_api:SELECT=2 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:03.558194 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=4 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:03.667662 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.network.neutron [None req-57735b57-2503-4614-8649-02521c4e8a08 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] validate_networks() for [('bb715288-0a54-4ca5-85b6-5a7823648ca0', None, None, None, None, None)] {{(pid=134667) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 13:48:04.044252 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-57735b57-2503-4614-8649-02521c4e8a08 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Flavor limits 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 13:48:04.044737 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-57735b57-2503-4614-8649-02521c4e8a08 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Image limits 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 13:48:04.045217 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-57735b57-2503-4614-8649-02521c4e8a08 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Flavor pref 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 13:48:04.045623 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-57735b57-2503-4614-8649-02521c4e8a08 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Image pref 0:0:0 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 13:48:04.046030 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.virt.hardware [None req-57735b57-2503-4614-8649-02521c4e8a08 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134667) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 13:48:04.055627 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-57735b57-2503-4614-8649-02521c4e8a08 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:04.056112 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-57735b57-2503-4614-8649-02521c4e8a08 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:04.064551 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-57735b57-2503-4614-8649-02521c4e8a08 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:04.064551 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-57735b57-2503-4614-8649-02521c4e8a08 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:04.078069 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.quota [None req-57735b57-2503-4614-8649-02521c4e8a08 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Getting quotas for project 0d6c438e59834c4084c818053e1fdb93. Resources: {'ram', 'cores', 'instances'} {{(pid=134667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:48:04.082301 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.quota [None req-57735b57-2503-4614-8649-02521c4e8a08 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Getting quotas for user 0a9f85caf65f431c96f27a7d04734211 and project 0d6c438e59834c4084c818053e1fdb93. Resources: {'ram', 'cores', 'instances'} {{(pid=134667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:48:04.142171 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-57735b57-2503-4614-8649-02521c4e8a08 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Going to run 1 instances... {{(pid=134667) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 13:48:04.144300 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-57735b57-2503-4614-8649-02521c4e8a08 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 02fa04ed-3477-423e-b4bc-2a860638bd30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='22c90307-b66b-4e3d-8862-5d5b0491d80a',volume_size=None,volume_type=None)] {{(pid=134667) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 13:48:04.275535 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-57735b57-2503-4614-8649-02521c4e8a08 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.730906 Jun 23 13:48:04.276364 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 493/973] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Jun 23 13:48:03 2022] POST /compute/v2.1/servers => generated 403 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 13:48:04.286767 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-52b25b81-7a5d-4f85-bcce-eda0fd32fd70 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:04.287487 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-52b25b81-7a5d-4f85-bcce-eda0fd32fd70 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 02fa04ed-3477-423e-b4bc-2a860638bd30] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:04.352880 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-52b25b81-7a5d-4f85-bcce-eda0fd32fd70 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:04.359983 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-52b25b81-7a5d-4f85-bcce-eda0fd32fd70 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30" status: 200 len: 1095 microversion: 2.1 time: 0.077513 Jun 23 13:48:04.360794 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 481/974] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:04 2022] GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30 => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:05.377644 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-9baa583d-b1d7-49bf-90e4-a16fafbe1fe3 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:05.378273 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-9baa583d-b1d7-49bf-90e4-a16fafbe1fe3 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 02fa04ed-3477-423e-b4bc-2a860638bd30] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:05.386332 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9baa583d-b1d7-49bf-90e4-a16fafbe1fe3 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:05.386814 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9baa583d-b1d7-49bf-90e4-a16fafbe1fe3 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:05.387802 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9baa583d-b1d7-49bf-90e4-a16fafbe1fe3 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:05.388653 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9baa583d-b1d7-49bf-90e4-a16fafbe1fe3 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:05.450322 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-9baa583d-b1d7-49bf-90e4-a16fafbe1fe3 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:05.458569 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-9baa583d-b1d7-49bf-90e4-a16fafbe1fe3 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30" status: 200 len: 1145 microversion: 2.1 time: 0.084920 Jun 23 13:48:05.459128 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 494/975] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:05 2022] GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:06.475555 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-9847c472-b9db-4af9-91d3-2b2e2d26f5fb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:06.476263 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-9847c472-b9db-4af9-91d3-2b2e2d26f5fb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 02fa04ed-3477-423e-b4bc-2a860638bd30] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:06.484084 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9847c472-b9db-4af9-91d3-2b2e2d26f5fb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:06.484582 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9847c472-b9db-4af9-91d3-2b2e2d26f5fb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:06.485481 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9847c472-b9db-4af9-91d3-2b2e2d26f5fb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:06.485979 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9847c472-b9db-4af9-91d3-2b2e2d26f5fb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:06.551048 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-9847c472-b9db-4af9-91d3-2b2e2d26f5fb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:06.558649 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-9847c472-b9db-4af9-91d3-2b2e2d26f5fb tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30" status: 200 len: 1137 microversion: 2.1 time: 0.087115 Jun 23 13:48:06.559203 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 482/976] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:06 2022] GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30 => generated 1137 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:07.575887 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-7ed06de0-7379-44af-9741-8214d636a9f4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:07.576580 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-7ed06de0-7379-44af-9741-8214d636a9f4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 02fa04ed-3477-423e-b4bc-2a860638bd30] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:07.583760 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7ed06de0-7379-44af-9741-8214d636a9f4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:07.584276 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7ed06de0-7379-44af-9741-8214d636a9f4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:07.585125 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7ed06de0-7379-44af-9741-8214d636a9f4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:07.585591 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-7ed06de0-7379-44af-9741-8214d636a9f4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:07.652034 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-7ed06de0-7379-44af-9741-8214d636a9f4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:07.660881 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-7ed06de0-7379-44af-9741-8214d636a9f4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30" status: 200 len: 1193 microversion: 2.1 time: 0.088971 Jun 23 13:48:07.661787 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 495/977] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:07 2022] GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30 => generated 1193 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:08.678137 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-077ae27d-9c6f-4513-8a79-0a0809e91f5b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:08.678736 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-077ae27d-9c6f-4513-8a79-0a0809e91f5b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 02fa04ed-3477-423e-b4bc-2a860638bd30] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:08.685567 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-077ae27d-9c6f-4513-8a79-0a0809e91f5b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:08.686083 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-077ae27d-9c6f-4513-8a79-0a0809e91f5b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:08.686859 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-077ae27d-9c6f-4513-8a79-0a0809e91f5b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:08.687297 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-077ae27d-9c6f-4513-8a79-0a0809e91f5b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:08.826696 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-077ae27d-9c6f-4513-8a79-0a0809e91f5b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:08.835667 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-077ae27d-9c6f-4513-8a79-0a0809e91f5b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30" status: 200 len: 1276 microversion: 2.1 time: 0.161294 Jun 23 13:48:08.836226 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 483/978] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:08 2022] GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30 => generated 1276 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:09.018753 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-d2f6d516-14d4-4537-8c0d-a4ea1bbc5419 req-9fbb6489-d95a-4b36-be40-cac92c6906c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02fa04ed-3477-423e-b4bc-2a860638bd30", "tag": "3e3135bb-5e40-457d-b725-fb3c8289323a"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:48:09.030817 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-d2f6d516-14d4-4537-8c0d-a4ea1bbc5419 req-9fbb6489-d95a-4b36-be40-cac92c6906c5 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:09.031679 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-d2f6d516-14d4-4537-8c0d-a4ea1bbc5419 req-9fbb6489-d95a-4b36-be40-cac92c6906c5 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:09.045647 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-d2f6d516-14d4-4537-8c0d-a4ea1bbc5419 req-9fbb6489-d95a-4b36-be40-cac92c6906c5 service nova] Creating event network-changed:3e3135bb-5e40-457d-b725-fb3c8289323a for instance 02fa04ed-3477-423e-b4bc-2a860638bd30 on hv-cinder-81558 Jun 23 13:48:09.051217 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-d2f6d516-14d4-4537-8c0d-a4ea1bbc5419 req-9fbb6489-d95a-4b36-be40-cac92c6906c5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037712 Jun 23 13:48:09.052131 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 496/979] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:48:09.713223 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-e67e3859-8596-4e9a-bb54-b5c83483e942 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:48:09.720054 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e67e3859-8596-4e9a-bb54-b5c83483e942 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:09.720503 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e67e3859-8596-4e9a-bb54-b5c83483e942 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:09.783766 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-e67e3859-8596-4e9a-bb54-b5c83483e942 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Going to try to stop instance {{(pid=134666) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 23 13:48:09.828272 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-e67e3859-8596-4e9a-bb54-b5c83483e942 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "POST /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a/action" status: 202 len: 0 microversion: 2.1 time: 0.118786 Jun 23 13:48:09.832675 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 484/980] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Jun 23 13:48:09 2022] POST /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 13:48:09.839209 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-d4bbb183-dae4-4394-a633-18e4b510a778 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:09.840290 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-d4bbb183-dae4-4394-a633-18e4b510a778 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:09.848801 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d4bbb183-dae4-4394-a633-18e4b510a778 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:09.849758 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d4bbb183-dae4-4394-a633-18e4b510a778 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:09.850640 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d4bbb183-dae4-4394-a633-18e4b510a778 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:09.851324 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d4bbb183-dae4-4394-a633-18e4b510a778 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:09.856027 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-171dfab3-7835-4d4e-875a-328c006406fc tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:09.856733 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-171dfab3-7835-4d4e-875a-328c006406fc tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 02fa04ed-3477-423e-b4bc-2a860638bd30] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:09.865340 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-171dfab3-7835-4d4e-875a-328c006406fc tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:09.865833 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-171dfab3-7835-4d4e-875a-328c006406fc tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:09.866577 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-171dfab3-7835-4d4e-875a-328c006406fc tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:09.867054 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-171dfab3-7835-4d4e-875a-328c006406fc tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:10.060274 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-171dfab3-7835-4d4e-875a-328c006406fc tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:10.065165 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-d4bbb183-dae4-4394-a633-18e4b510a778 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:10.069211 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-171dfab3-7835-4d4e-875a-328c006406fc tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30" status: 200 len: 1276 microversion: 2.1 time: 0.219944 Jun 23 13:48:10.079314 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-d4bbb183-dae4-4394-a633-18e4b510a778 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1723 microversion: 2.1 time: 0.240850 Jun 23 13:48:10.079314 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 497/981] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:09 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:48:10.080684 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 485/982] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:09 2022] GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30 => generated 1276 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:11.086420 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-4e4e97b3-9c3b-48d9-830c-6d0afe20578a tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:11.087068 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-4e4e97b3-9c3b-48d9-830c-6d0afe20578a tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 02fa04ed-3477-423e-b4bc-2a860638bd30] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:11.093656 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4e4e97b3-9c3b-48d9-830c-6d0afe20578a tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:11.094106 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4e4e97b3-9c3b-48d9-830c-6d0afe20578a tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:11.094907 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4e4e97b3-9c3b-48d9-830c-6d0afe20578a tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:11.095362 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4e4e97b3-9c3b-48d9-830c-6d0afe20578a tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:11.097702 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-87926745-30bd-478a-97c7-884b219c4869 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:11.098318 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-87926745-30bd-478a-97c7-884b219c4869 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:11.112098 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-87926745-30bd-478a-97c7-884b219c4869 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:11.112590 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-87926745-30bd-478a-97c7-884b219c4869 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:11.113461 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-87926745-30bd-478a-97c7-884b219c4869 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:11.113939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-87926745-30bd-478a-97c7-884b219c4869 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:11.291658 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-4e4e97b3-9c3b-48d9-830c-6d0afe20578a tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:11.296963 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-87926745-30bd-478a-97c7-884b219c4869 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:11.302261 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-4e4e97b3-9c3b-48d9-830c-6d0afe20578a tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30" status: 200 len: 1264 microversion: 2.1 time: 0.219550 Jun 23 13:48:11.303081 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 498/983] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:11 2022] GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30 => generated 1264 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:11.308343 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-87926745-30bd-478a-97c7-884b219c4869 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1723 microversion: 2.1 time: 0.214650 Jun 23 13:48:11.309044 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 486/984] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:11 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:12.325956 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-aee67483-b530-4be8-adde-9f33a2269739 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:12.326549 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-aee67483-b530-4be8-adde-9f33a2269739 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 02fa04ed-3477-423e-b4bc-2a860638bd30] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:12.328390 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-25013d5c-a9b1-4779-9f12-b0bd6093d755 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:12.329349 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-25013d5c-a9b1-4779-9f12-b0bd6093d755 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:12.333697 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-aee67483-b530-4be8-adde-9f33a2269739 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:12.334152 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-aee67483-b530-4be8-adde-9f33a2269739 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:12.334915 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-aee67483-b530-4be8-adde-9f33a2269739 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:12.335357 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-aee67483-b530-4be8-adde-9f33a2269739 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:12.335953 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-25013d5c-a9b1-4779-9f12-b0bd6093d755 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:12.336404 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-25013d5c-a9b1-4779-9f12-b0bd6093d755 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:12.337255 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-25013d5c-a9b1-4779-9f12-b0bd6093d755 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:12.337636 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-25013d5c-a9b1-4779-9f12-b0bd6093d755 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:12.525446 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-aee67483-b530-4be8-adde-9f33a2269739 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:12.528487 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-25013d5c-a9b1-4779-9f12-b0bd6093d755 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:12.533438 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-aee67483-b530-4be8-adde-9f33a2269739 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30" status: 200 len: 1264 microversion: 2.1 time: 0.213945 Jun 23 13:48:12.534020 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 499/985] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:12 2022] GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30 => generated 1264 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:12.537381 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-25013d5c-a9b1-4779-9f12-b0bd6093d755 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1723 microversion: 2.1 time: 0.213926 Jun 23 13:48:12.537939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 487/986] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:12 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:13.550862 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-fabd0008-805f-4f4e-b879-3f530300b571 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:13.551795 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-fabd0008-805f-4f4e-b879-3f530300b571 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 02fa04ed-3477-423e-b4bc-2a860638bd30] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:13.555819 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-76aad91e-f87d-46cd-af52-ba8fe45f1251 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:13.556742 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-76aad91e-f87d-46cd-af52-ba8fe45f1251 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:13.558646 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fabd0008-805f-4f4e-b879-3f530300b571 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:13.559096 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fabd0008-805f-4f4e-b879-3f530300b571 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:13.560295 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fabd0008-805f-4f4e-b879-3f530300b571 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:13.560295 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fabd0008-805f-4f4e-b879-3f530300b571 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:13.567008 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-76aad91e-f87d-46cd-af52-ba8fe45f1251 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:13.567008 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-76aad91e-f87d-46cd-af52-ba8fe45f1251 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:13.567008 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-76aad91e-f87d-46cd-af52-ba8fe45f1251 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:13.567008 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-76aad91e-f87d-46cd-af52-ba8fe45f1251 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:13.765662 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-fabd0008-805f-4f4e-b879-3f530300b571 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:13.770237 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-76aad91e-f87d-46cd-af52-ba8fe45f1251 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:13.774375 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-fabd0008-805f-4f4e-b879-3f530300b571 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30" status: 200 len: 1264 microversion: 2.1 time: 0.227763 Jun 23 13:48:13.774986 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 500/987] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:13 2022] GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30 => generated 1264 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:13.778471 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-76aad91e-f87d-46cd-af52-ba8fe45f1251 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1723 microversion: 2.1 time: 0.226711 Jun 23 13:48:13.779085 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 488/988] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:13 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:14.793603 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-62828f7c-6553-4ef0-8fb6-6dd1f5ed4c1c tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:14.794436 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-62828f7c-6553-4ef0-8fb6-6dd1f5ed4c1c tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 02fa04ed-3477-423e-b4bc-2a860638bd30] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:14.796434 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-9f210c5d-c601-496e-bf2a-d4c64cefb685 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:14.796868 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell0:SELECT=2 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:14.797280 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell0:SELECT=6 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:14.797942 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-9f210c5d-c601-496e-bf2a-d4c64cefb685 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:14.801967 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell0:SELECT=2 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:14.804209 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-62828f7c-6553-4ef0-8fb6-6dd1f5ed4c1c tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:14.804652 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-62828f7c-6553-4ef0-8fb6-6dd1f5ed4c1c tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:14.805689 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-62828f7c-6553-4ef0-8fb6-6dd1f5ed4c1c tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:14.806094 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-62828f7c-6553-4ef0-8fb6-6dd1f5ed4c1c tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:14.808080 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9f210c5d-c601-496e-bf2a-d4c64cefb685 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:14.808685 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9f210c5d-c601-496e-bf2a-d4c64cefb685 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:14.810116 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9f210c5d-c601-496e-bf2a-d4c64cefb685 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:14.810775 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9f210c5d-c601-496e-bf2a-d4c64cefb685 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:15.023221 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-62828f7c-6553-4ef0-8fb6-6dd1f5ed4c1c tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:15.025950 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-9f210c5d-c601-496e-bf2a-d4c64cefb685 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:15.031639 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-62828f7c-6553-4ef0-8fb6-6dd1f5ed4c1c tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30" status: 200 len: 1264 microversion: 2.1 time: 0.243699 Jun 23 13:48:15.032427 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 501/989] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:14 2022] GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30 => generated 1264 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:15.034373 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-9f210c5d-c601-496e-bf2a-d4c64cefb685 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1723 microversion: 2.1 time: 0.242319 Jun 23 13:48:15.034931 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 489/990] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:14 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:48:16.049198 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-138cb4d1-0d52-4327-9456-99b70f9d7dfd tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:16.050516 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-138cb4d1-0d52-4327-9456-99b70f9d7dfd tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 02fa04ed-3477-423e-b4bc-2a860638bd30] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:16.055507 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-8736dbe1-afe5-4cdc-b3b5-4bb76e59c7f2 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:16.056281 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-8736dbe1-afe5-4cdc-b3b5-4bb76e59c7f2 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:16.059068 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-138cb4d1-0d52-4327-9456-99b70f9d7dfd tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:16.059618 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-138cb4d1-0d52-4327-9456-99b70f9d7dfd tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:16.060531 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-138cb4d1-0d52-4327-9456-99b70f9d7dfd tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:16.061003 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-138cb4d1-0d52-4327-9456-99b70f9d7dfd tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:16.064392 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8736dbe1-afe5-4cdc-b3b5-4bb76e59c7f2 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:16.064914 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8736dbe1-afe5-4cdc-b3b5-4bb76e59c7f2 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:16.065762 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8736dbe1-afe5-4cdc-b3b5-4bb76e59c7f2 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:16.066205 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8736dbe1-afe5-4cdc-b3b5-4bb76e59c7f2 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:16.268618 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-138cb4d1-0d52-4327-9456-99b70f9d7dfd tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:16.275364 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-8736dbe1-afe5-4cdc-b3b5-4bb76e59c7f2 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:16.277190 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-138cb4d1-0d52-4327-9456-99b70f9d7dfd tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30" status: 200 len: 1264 microversion: 2.1 time: 0.232879 Jun 23 13:48:16.277776 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 502/991] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:16 2022] GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30 => generated 1264 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:16.283683 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-8736dbe1-afe5-4cdc-b3b5-4bb76e59c7f2 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1723 microversion: 2.1 time: 0.234030 Jun 23 13:48:16.284238 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 490/992] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:16 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:17.295164 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-47ee0824-91dd-4774-b342-e2e29c2ae42d tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:17.295808 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-47ee0824-91dd-4774-b342-e2e29c2ae42d tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 02fa04ed-3477-423e-b4bc-2a860638bd30] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:17.300775 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-33bf28d8-f915-42a3-a4de-aa1fc842df48 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:17.301400 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-33bf28d8-f915-42a3-a4de-aa1fc842df48 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:17.302880 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-47ee0824-91dd-4774-b342-e2e29c2ae42d tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:17.303356 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-47ee0824-91dd-4774-b342-e2e29c2ae42d tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:17.304138 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-47ee0824-91dd-4774-b342-e2e29c2ae42d tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:17.304577 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-47ee0824-91dd-4774-b342-e2e29c2ae42d tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:17.308695 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-33bf28d8-f915-42a3-a4de-aa1fc842df48 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:17.309143 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-33bf28d8-f915-42a3-a4de-aa1fc842df48 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:17.309907 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-33bf28d8-f915-42a3-a4de-aa1fc842df48 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:17.310342 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-33bf28d8-f915-42a3-a4de-aa1fc842df48 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:17.517355 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-47ee0824-91dd-4774-b342-e2e29c2ae42d tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:17.522719 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-33bf28d8-f915-42a3-a4de-aa1fc842df48 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:17.527318 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-47ee0824-91dd-4774-b342-e2e29c2ae42d tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30" status: 200 len: 1264 microversion: 2.1 time: 0.236051 Jun 23 13:48:17.530003 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 503/993] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:17 2022] GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30 => generated 1264 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:17.533571 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-33bf28d8-f915-42a3-a4de-aa1fc842df48 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1723 microversion: 2.1 time: 0.236753 Jun 23 13:48:17.534111 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 491/994] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:17 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:18.547287 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-25063c40-a3fb-4b23-85b9-3d747b4f63f8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:18.547941 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-25063c40-a3fb-4b23-85b9-3d747b4f63f8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 02fa04ed-3477-423e-b4bc-2a860638bd30] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:18.550407 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-951b03c2-8720-4a3a-811a-4345bc9f927a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:18.551061 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-951b03c2-8720-4a3a-811a-4345bc9f927a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:18.554818 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-25063c40-a3fb-4b23-85b9-3d747b4f63f8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:18.555271 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-25063c40-a3fb-4b23-85b9-3d747b4f63f8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:18.556084 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-25063c40-a3fb-4b23-85b9-3d747b4f63f8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:18.556527 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-25063c40-a3fb-4b23-85b9-3d747b4f63f8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:18.558130 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-951b03c2-8720-4a3a-811a-4345bc9f927a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:18.558578 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-951b03c2-8720-4a3a-811a-4345bc9f927a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:18.559365 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-951b03c2-8720-4a3a-811a-4345bc9f927a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:18.559819 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-951b03c2-8720-4a3a-811a-4345bc9f927a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:19.004364 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-25063c40-a3fb-4b23-85b9-3d747b4f63f8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:19.007914 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-951b03c2-8720-4a3a-811a-4345bc9f927a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:19.012914 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-25063c40-a3fb-4b23-85b9-3d747b4f63f8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30" status: 200 len: 1264 microversion: 2.1 time: 0.469778 Jun 23 13:48:19.014086 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 504/995] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:18 2022] GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30 => generated 1264 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:19.016879 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-951b03c2-8720-4a3a-811a-4345bc9f927a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1723 microversion: 2.1 time: 0.470656 Jun 23 13:48:19.017833 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 492/996] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:18 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1723 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:20.033468 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-dabb47ec-4785-46af-ab23-86ba186fe50c tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:20.034193 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-dabb47ec-4785-46af-ab23-86ba186fe50c tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 02fa04ed-3477-423e-b4bc-2a860638bd30] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:20.035832 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-58b8d347-efae-4375-a3af-8e0b56b8a705 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:20.036586 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-58b8d347-efae-4375-a3af-8e0b56b8a705 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:20.042828 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-dabb47ec-4785-46af-ab23-86ba186fe50c tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:20.043396 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-dabb47ec-4785-46af-ab23-86ba186fe50c tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:20.044330 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-dabb47ec-4785-46af-ab23-86ba186fe50c tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:20.044504 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-58b8d347-efae-4375-a3af-8e0b56b8a705 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:20.044842 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-dabb47ec-4785-46af-ab23-86ba186fe50c tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:20.045016 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-58b8d347-efae-4375-a3af-8e0b56b8a705 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:20.046292 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-58b8d347-efae-4375-a3af-8e0b56b8a705 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:20.046808 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-58b8d347-efae-4375-a3af-8e0b56b8a705 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:20.247206 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-dabb47ec-4785-46af-ab23-86ba186fe50c tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:20.254036 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-58b8d347-efae-4375-a3af-8e0b56b8a705 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:20.255213 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-dabb47ec-4785-46af-ab23-86ba186fe50c tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30" status: 200 len: 1264 microversion: 2.1 time: 0.227680 Jun 23 13:48:20.255830 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 505/997] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:20 2022] GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30 => generated 1264 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:20.262298 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-58b8d347-efae-4375-a3af-8e0b56b8a705 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1723 microversion: 2.1 time: 0.231424 Jun 23 13:48:20.262898 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 493/998] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:20 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:21.276336 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-5fe52136-8a20-432a-a5c8-38bbed2a28c5 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:21.277055 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-5fe52136-8a20-432a-a5c8-38bbed2a28c5 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 02fa04ed-3477-423e-b4bc-2a860638bd30] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:21.279940 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-99b8c196-4dea-46fb-96cc-f28eb855f8e4 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:21.280541 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-99b8c196-4dea-46fb-96cc-f28eb855f8e4 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:21.284622 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5fe52136-8a20-432a-a5c8-38bbed2a28c5 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:21.285146 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5fe52136-8a20-432a-a5c8-38bbed2a28c5 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:21.286074 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5fe52136-8a20-432a-a5c8-38bbed2a28c5 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:21.286518 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-5fe52136-8a20-432a-a5c8-38bbed2a28c5 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:21.288267 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-99b8c196-4dea-46fb-96cc-f28eb855f8e4 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:21.288727 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-99b8c196-4dea-46fb-96cc-f28eb855f8e4 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:21.289511 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-99b8c196-4dea-46fb-96cc-f28eb855f8e4 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:21.289949 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-99b8c196-4dea-46fb-96cc-f28eb855f8e4 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:21.485088 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-5fe52136-8a20-432a-a5c8-38bbed2a28c5 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:21.489052 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-99b8c196-4dea-46fb-96cc-f28eb855f8e4 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:21.493527 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-5fe52136-8a20-432a-a5c8-38bbed2a28c5 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30" status: 200 len: 1264 microversion: 2.1 time: 0.222978 Jun 23 13:48:21.494099 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 506/999] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:21 2022] GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30 => generated 1264 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:21.499216 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-99b8c196-4dea-46fb-96cc-f28eb855f8e4 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1723 microversion: 2.1 time: 0.223409 Jun 23 13:48:21.499846 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 494/1000] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:21 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:22.517611 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-83edf177-9154-4c51-8693-f1d960f20377 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:22.518490 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-cca40272-d151-421c-b7b2-fb6bd4c536e9 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:22.519104 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-cca40272-d151-421c-b7b2-fb6bd4c536e9 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 02fa04ed-3477-423e-b4bc-2a860638bd30] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:22.521047 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-83edf177-9154-4c51-8693-f1d960f20377 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:22.529164 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-83edf177-9154-4c51-8693-f1d960f20377 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:22.529332 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-cca40272-d151-421c-b7b2-fb6bd4c536e9 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:22.529693 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-cca40272-d151-421c-b7b2-fb6bd4c536e9 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:22.530165 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-83edf177-9154-4c51-8693-f1d960f20377 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:22.530438 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-cca40272-d151-421c-b7b2-fb6bd4c536e9 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:22.531084 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-cca40272-d151-421c-b7b2-fb6bd4c536e9 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:22.531204 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-83edf177-9154-4c51-8693-f1d960f20377 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:22.531658 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-83edf177-9154-4c51-8693-f1d960f20377 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:22.537848 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:22.740507 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-83edf177-9154-4c51-8693-f1d960f20377 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:22.744624 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-cca40272-d151-421c-b7b2-fb6bd4c536e9 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:22.755746 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-cca40272-d151-421c-b7b2-fb6bd4c536e9 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30" status: 200 len: 1264 microversion: 2.1 time: 0.249019 Jun 23 13:48:22.756340 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 507/1001] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:22 2022] GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30 => generated 1264 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:22.758360 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-83edf177-9154-4c51-8693-f1d960f20377 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1700 microversion: 2.1 time: 0.245649 Jun 23 13:48:22.758905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 495/1002] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:22 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1700 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:48:22.775419 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-c029203a-2591-4b9e-ab3b-68d54cc2388c tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:48:22.781968 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c029203a-2591-4b9e-ab3b-68d54cc2388c tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:22.782426 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c029203a-2591-4b9e-ab3b-68d54cc2388c tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:22.814337 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-1530016d-8a2a-4d4f-9978-29ec8205f73f req-6b24a701-6c20-47a0-9319-7dc42113785d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02fa04ed-3477-423e-b4bc-2a860638bd30", "name": "network-vif-plugged", "status": "completed", "tag": "3e3135bb-5e40-457d-b725-fb3c8289323a"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:48:22.823165 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-1530016d-8a2a-4d4f-9978-29ec8205f73f req-6b24a701-6c20-47a0-9319-7dc42113785d service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:22.823681 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-1530016d-8a2a-4d4f-9978-29ec8205f73f req-6b24a701-6c20-47a0-9319-7dc42113785d service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:22.837198 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-1530016d-8a2a-4d4f-9978-29ec8205f73f req-6b24a701-6c20-47a0-9319-7dc42113785d service nova] Creating event network-vif-plugged:3e3135bb-5e40-457d-b725-fb3c8289323a for instance 02fa04ed-3477-423e-b4bc-2a860638bd30 on hv-cinder-81558 Jun 23 13:48:22.843687 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-1530016d-8a2a-4d4f-9978-29ec8205f73f req-6b24a701-6c20-47a0-9319-7dc42113785d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032784 Jun 23 13:48:22.844560 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 496/1003] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:48:22.846872 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-c029203a-2591-4b9e-ab3b-68d54cc2388c tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Going to try to start instance {{(pid=134667) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 23 13:48:22.897997 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-c029203a-2591-4b9e-ab3b-68d54cc2388c tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "POST /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a/action" status: 202 len: 0 microversion: 2.1 time: 0.126720 Jun 23 13:48:22.898623 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 508/1004] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Jun 23 13:48:22 2022] POST /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 13:48:22.909687 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-771b1096-c8c2-43ee-85ea-c8c366cdef8c tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:22.910423 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-771b1096-c8c2-43ee-85ea-c8c366cdef8c tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:22.917220 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-771b1096-c8c2-43ee-85ea-c8c366cdef8c tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:22.917642 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-771b1096-c8c2-43ee-85ea-c8c366cdef8c tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:22.918418 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-771b1096-c8c2-43ee-85ea-c8c366cdef8c tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:22.918861 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-771b1096-c8c2-43ee-85ea-c8c366cdef8c tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:23.063133 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-771b1096-c8c2-43ee-85ea-c8c366cdef8c tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:23.071723 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-771b1096-c8c2-43ee-85ea-c8c366cdef8c tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1709 microversion: 2.1 time: 0.166476 Jun 23 13:48:23.072331 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 497/1005] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:22 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1709 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:23.776683 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-2ce691b8-0bad-4e13-9c5c-7f38b75ea65b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:23.777454 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-2ce691b8-0bad-4e13-9c5c-7f38b75ea65b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 02fa04ed-3477-423e-b4bc-2a860638bd30] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:23.786044 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2ce691b8-0bad-4e13-9c5c-7f38b75ea65b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:23.786523 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2ce691b8-0bad-4e13-9c5c-7f38b75ea65b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:23.787272 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2ce691b8-0bad-4e13-9c5c-7f38b75ea65b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:23.787733 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-2ce691b8-0bad-4e13-9c5c-7f38b75ea65b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:23.951510 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-2ce691b8-0bad-4e13-9c5c-7f38b75ea65b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:23.958594 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:48:23.961247 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-2ce691b8-0bad-4e13-9c5c-7f38b75ea65b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30" status: 200 len: 1264 microversion: 2.1 time: 0.191534 Jun 23 13:48:23.962555 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 509/1006] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:23 2022] GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30 => generated 1264 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:24.090495 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c6f4c225-f80f-47c7-ab84-4cc1526a3a65 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:24.091107 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-c6f4c225-f80f-47c7-ab84-4cc1526a3a65 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:24.098102 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c6f4c225-f80f-47c7-ab84-4cc1526a3a65 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:24.098564 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c6f4c225-f80f-47c7-ab84-4cc1526a3a65 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:24.099353 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c6f4c225-f80f-47c7-ab84-4cc1526a3a65 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:24.099809 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c6f4c225-f80f-47c7-ab84-4cc1526a3a65 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:24.238461 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-c6f4c225-f80f-47c7-ab84-4cc1526a3a65 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:24.247288 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-c6f4c225-f80f-47c7-ab84-4cc1526a3a65 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1709 microversion: 2.1 time: 0.160835 Jun 23 13:48:24.247959 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 498/1007] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:24 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1709 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:24.978482 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-dcf3267e-e161-4876-9e03-9b2fdbbc70be tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:24.979084 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-dcf3267e-e161-4876-9e03-9b2fdbbc70be tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 02fa04ed-3477-423e-b4bc-2a860638bd30] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:24.989468 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-dcf3267e-e161-4876-9e03-9b2fdbbc70be tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:24.989918 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-dcf3267e-e161-4876-9e03-9b2fdbbc70be tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:24.990692 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-dcf3267e-e161-4876-9e03-9b2fdbbc70be tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:24.991126 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-dcf3267e-e161-4876-9e03-9b2fdbbc70be tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:25.124334 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-dcf3267e-e161-4876-9e03-9b2fdbbc70be tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:25.131933 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-dcf3267e-e161-4876-9e03-9b2fdbbc70be tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30" status: 200 len: 1264 microversion: 2.1 time: 0.157487 Jun 23 13:48:25.132494 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 510/1008] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:24 2022] GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:25.267569 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-678776c0-a21c-4c0a-b94f-863961cf53e9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:25.268471 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-678776c0-a21c-4c0a-b94f-863961cf53e9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:25.278690 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-678776c0-a21c-4c0a-b94f-863961cf53e9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:25.279396 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-678776c0-a21c-4c0a-b94f-863961cf53e9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:25.280577 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-678776c0-a21c-4c0a-b94f-863961cf53e9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:25.281243 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-678776c0-a21c-4c0a-b94f-863961cf53e9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:25.426583 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-678776c0-a21c-4c0a-b94f-863961cf53e9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:25.435136 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-678776c0-a21c-4c0a-b94f-863961cf53e9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1709 microversion: 2.1 time: 0.173683 Jun 23 13:48:25.435762 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 499/1009] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:25 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1709 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:26.150674 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-fd04cd53-86fd-47b6-b9c1-27bf3c1d21a4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:26.151579 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-fd04cd53-86fd-47b6-b9c1-27bf3c1d21a4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 02fa04ed-3477-423e-b4bc-2a860638bd30] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:26.160493 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fd04cd53-86fd-47b6-b9c1-27bf3c1d21a4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:26.161087 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fd04cd53-86fd-47b6-b9c1-27bf3c1d21a4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:26.162087 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fd04cd53-86fd-47b6-b9c1-27bf3c1d21a4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:26.162659 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fd04cd53-86fd-47b6-b9c1-27bf3c1d21a4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:26.313883 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-fd04cd53-86fd-47b6-b9c1-27bf3c1d21a4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:26.325976 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-fd04cd53-86fd-47b6-b9c1-27bf3c1d21a4 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30" status: 200 len: 1264 microversion: 2.1 time: 0.180635 Jun 23 13:48:26.326811 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 511/1010] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:26 2022] GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30 => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:26.461085 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-cb430aa4-e4fc-4902-882b-2fc8d6f9475e tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:26.462094 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-cb430aa4-e4fc-4902-882b-2fc8d6f9475e tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:26.473101 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-cb430aa4-e4fc-4902-882b-2fc8d6f9475e tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:26.473834 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-cb430aa4-e4fc-4902-882b-2fc8d6f9475e tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:26.474600 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-cb430aa4-e4fc-4902-882b-2fc8d6f9475e tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:26.475037 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-cb430aa4-e4fc-4902-882b-2fc8d6f9475e tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:26.614522 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-cb430aa4-e4fc-4902-882b-2fc8d6f9475e tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:26.622714 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-cb430aa4-e4fc-4902-882b-2fc8d6f9475e tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1709 microversion: 2.1 time: 0.168760 Jun 23 13:48:26.623279 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 500/1011] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:26 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1709 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:27.348026 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-0ceec46f-62c8-4db0-a2bd-57bf005821f5 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:27.349053 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-0ceec46f-62c8-4db0-a2bd-57bf005821f5 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 02fa04ed-3477-423e-b4bc-2a860638bd30] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:27.356392 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0ceec46f-62c8-4db0-a2bd-57bf005821f5 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:27.356846 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0ceec46f-62c8-4db0-a2bd-57bf005821f5 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:27.357608 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0ceec46f-62c8-4db0-a2bd-57bf005821f5 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:27.358056 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0ceec46f-62c8-4db0-a2bd-57bf005821f5 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:27.493512 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-0ceec46f-62c8-4db0-a2bd-57bf005821f5 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:27.505426 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-0ceec46f-62c8-4db0-a2bd-57bf005821f5 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30" status: 200 len: 1452 microversion: 2.1 time: 0.163743 Jun 23 13:48:27.506138 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 512/1012] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:27 2022] GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:27.521883 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-617be5c8-092a-48d9-8262-6e9f9c8a6704 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:27.522552 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-617be5c8-092a-48d9-8262-6e9f9c8a6704 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 02fa04ed-3477-423e-b4bc-2a860638bd30] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:27.529188 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-617be5c8-092a-48d9-8262-6e9f9c8a6704 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:27.529637 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-617be5c8-092a-48d9-8262-6e9f9c8a6704 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:27.530389 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-617be5c8-092a-48d9-8262-6e9f9c8a6704 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:27.530821 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-617be5c8-092a-48d9-8262-6e9f9c8a6704 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:27.640216 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-26c9a156-ae6c-4f53-9579-642302bc9524 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:48:27.640810 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-26c9a156-ae6c-4f53-9579-642302bc9524 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:48:27.647031 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-26c9a156-ae6c-4f53-9579-642302bc9524 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:27.647527 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-26c9a156-ae6c-4f53-9579-642302bc9524 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:27.648294 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-26c9a156-ae6c-4f53-9579-642302bc9524 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:27.648737 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-26c9a156-ae6c-4f53-9579-642302bc9524 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:27.672580 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-617be5c8-092a-48d9-8262-6e9f9c8a6704 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:27.680389 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-617be5c8-092a-48d9-8262-6e9f9c8a6704 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30" status: 200 len: 1452 microversion: 2.1 time: 0.162636 Jun 23 13:48:27.680956 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 501/1013] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:27 2022] GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:48:27.784623 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-26c9a156-ae6c-4f53-9579-642302bc9524 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:48:27.793043 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-26c9a156-ae6c-4f53-9579-642302bc9524 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1713 microversion: 2.1 time: 0.156946 Jun 23 13:48:27.793621 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 513/1014] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:48:27 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1713 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:48:29.282171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-944f023f-63a1-4067-8a21-24cea901c87c req-b78bf9a8-1b7f-4d39-9f84-de1b20149b96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02fa04ed-3477-423e-b4bc-2a860638bd30", "tag": "3e3135bb-5e40-457d-b725-fb3c8289323a"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:48:29.290968 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-944f023f-63a1-4067-8a21-24cea901c87c req-b78bf9a8-1b7f-4d39-9f84-de1b20149b96 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:48:29.291458 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-944f023f-63a1-4067-8a21-24cea901c87c req-b78bf9a8-1b7f-4d39-9f84-de1b20149b96 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:48:29.303782 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-944f023f-63a1-4067-8a21-24cea901c87c req-b78bf9a8-1b7f-4d39-9f84-de1b20149b96 service nova] Creating event network-changed:3e3135bb-5e40-457d-b725-fb3c8289323a for instance 02fa04ed-3477-423e-b4bc-2a860638bd30 on hv-cinder-81558 Jun 23 13:48:29.308903 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-944f023f-63a1-4067-8a21-24cea901c87c req-b78bf9a8-1b7f-4d39-9f84-de1b20149b96 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030538 Jun 23 13:48:29.309685 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 502/1015] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 13:49:07.215568 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-3508420c-70cd-44f8-b071-086f29d1c2e8 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:49:07.216617 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-3508420c-70cd-44f8-b071-086f29d1c2e8 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:49:07.219990 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:07.221042 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=24 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:07.230006 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3508420c-70cd-44f8-b071-086f29d1c2e8 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:07.230413 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3508420c-70cd-44f8-b071-086f29d1c2e8 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:07.231204 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3508420c-70cd-44f8-b071-086f29d1c2e8 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:07.231677 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3508420c-70cd-44f8-b071-086f29d1c2e8 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:07.313848 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.objects.instance [None req-3508420c-70cd-44f8-b071-086f29d1c2e8 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lazy-loading 'services' on Instance uuid a45e14a5-376a-40fb-8ea0-934aa3de116a {{(pid=134667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:49:07.390540 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-3508420c-70cd-44f8-b071-086f29d1c2e8 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a/os-volume_attachments/9fe8ba69-69a5-4e41-8e42-a0b0e992e7aa" status: 202 len: 0 microversion: 2.1 time: 0.181556 Jun 23 13:49:07.391119 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 514/1016] 10.222.0.26 () {58 vars in 1415 bytes} [Thu Jun 23 13:49:07 2022] DELETE /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a/os-volume_attachments/9fe8ba69-69a5-4e41-8e42-a0b0e992e7aa => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 13:49:08.513782 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_api:SELECT=48 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:08.514512 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:SELECT=38 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:08.518829 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-6071862d-1310-4900-a705-06f154cf8a62 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:49:08.525903 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6071862d-1310-4900-a705-06f154cf8a62 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:08.526358 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-6071862d-1310-4900-a705-06f154cf8a62 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:08.547948 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-6071862d-1310-4900-a705-06f154cf8a62 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Going to try to stop instance {{(pid=134666) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 23 13:49:08.598794 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-6071862d-1310-4900-a705-06f154cf8a62 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "POST /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a/action" status: 202 len: 0 microversion: 2.1 time: 0.086295 Jun 23 13:49:08.599732 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 503/1017] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Jun 23 13:49:08 2022] POST /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 13:49:08.609596 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-a222eec5-4f52-4239-a60a-a4c45ef404aa tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:49:08.610338 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-a222eec5-4f52-4239-a60a-a4c45ef404aa tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:49:08.618514 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a222eec5-4f52-4239-a60a-a4c45ef404aa tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:08.618973 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a222eec5-4f52-4239-a60a-a4c45ef404aa tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:08.619786 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a222eec5-4f52-4239-a60a-a4c45ef404aa tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:08.620227 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a222eec5-4f52-4239-a60a-a4c45ef404aa tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:08.753157 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-a222eec5-4f52-4239-a60a-a4c45ef404aa tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:49:08.761428 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-a222eec5-4f52-4239-a60a-a4c45ef404aa tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1677 microversion: 2.1 time: 0.156277 Jun 23 13:49:08.762001 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 515/1018] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:49:08 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:49:09.784587 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-5894a000-8c59-409b-a8a9-3f558e01072f tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:49:09.785728 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-5894a000-8c59-409b-a8a9-3f558e01072f tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:49:09.793824 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5894a000-8c59-409b-a8a9-3f558e01072f tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:09.794271 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5894a000-8c59-409b-a8a9-3f558e01072f tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:09.795025 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5894a000-8c59-409b-a8a9-3f558e01072f tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:09.795495 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-5894a000-8c59-409b-a8a9-3f558e01072f tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:09.925234 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-5894a000-8c59-409b-a8a9-3f558e01072f tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:49:09.933147 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-5894a000-8c59-409b-a8a9-3f558e01072f tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1677 microversion: 2.1 time: 0.156477 Jun 23 13:49:09.933728 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 504/1019] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:49:09 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:49:10.954901 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-51dc7fc7-b4a1-4370-b2f2-7066e9d11f3e tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:49:10.955965 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-51dc7fc7-b4a1-4370-b2f2-7066e9d11f3e tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:49:10.967318 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-51dc7fc7-b4a1-4370-b2f2-7066e9d11f3e tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:10.968120 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-51dc7fc7-b4a1-4370-b2f2-7066e9d11f3e tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:10.969381 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-51dc7fc7-b4a1-4370-b2f2-7066e9d11f3e tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:10.970111 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-51dc7fc7-b4a1-4370-b2f2-7066e9d11f3e tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:11.105539 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-51dc7fc7-b4a1-4370-b2f2-7066e9d11f3e tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:49:11.113373 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-51dc7fc7-b4a1-4370-b2f2-7066e9d11f3e tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1677 microversion: 2.1 time: 0.165385 Jun 23 13:49:11.113951 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 516/1020] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:49:10 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:49:12.130279 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-9386cc28-d587-45bd-b9b0-c2b6ae0f8286 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:49:12.130893 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-9386cc28-d587-45bd-b9b0-c2b6ae0f8286 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:49:12.137887 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9386cc28-d587-45bd-b9b0-c2b6ae0f8286 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:12.138336 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9386cc28-d587-45bd-b9b0-c2b6ae0f8286 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:12.139100 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9386cc28-d587-45bd-b9b0-c2b6ae0f8286 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:12.139587 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9386cc28-d587-45bd-b9b0-c2b6ae0f8286 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:12.273164 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-9386cc28-d587-45bd-b9b0-c2b6ae0f8286 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:49:12.281301 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-9386cc28-d587-45bd-b9b0-c2b6ae0f8286 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1677 microversion: 2.1 time: 0.154985 Jun 23 13:49:12.281875 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 505/1021] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:49:12 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:49:13.302471 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-b01efd00-3629-4b33-a42a-52f726a1ae0f tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:49:13.303554 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-b01efd00-3629-4b33-a42a-52f726a1ae0f tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:49:13.313792 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b01efd00-3629-4b33-a42a-52f726a1ae0f tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:13.314543 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b01efd00-3629-4b33-a42a-52f726a1ae0f tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:13.315843 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b01efd00-3629-4b33-a42a-52f726a1ae0f tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:13.316564 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b01efd00-3629-4b33-a42a-52f726a1ae0f tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:13.465998 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-b01efd00-3629-4b33-a42a-52f726a1ae0f tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:49:13.474314 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-b01efd00-3629-4b33-a42a-52f726a1ae0f tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1677 microversion: 2.1 time: 0.178685 Jun 23 13:49:13.474902 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 517/1022] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:49:13 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:49:14.494490 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-697be077-ab0d-4c96-927a-144265e0393e tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:49:14.495206 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-697be077-ab0d-4c96-927a-144265e0393e tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:49:14.503605 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-697be077-ab0d-4c96-927a-144265e0393e tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:14.504171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-697be077-ab0d-4c96-927a-144265e0393e tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:14.505127 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-697be077-ab0d-4c96-927a-144265e0393e tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:14.505674 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-697be077-ab0d-4c96-927a-144265e0393e tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:14.644772 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-697be077-ab0d-4c96-927a-144265e0393e tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:49:14.654055 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-697be077-ab0d-4c96-927a-144265e0393e tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1677 microversion: 2.1 time: 0.165588 Jun 23 13:49:14.654633 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 506/1023] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:49:14 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:49:15.672539 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-c7de82e6-844a-4dab-b0f7-6abab4e0bb73 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:49:15.673132 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-c7de82e6-844a-4dab-b0f7-6abab4e0bb73 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:49:15.680275 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c7de82e6-844a-4dab-b0f7-6abab4e0bb73 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:15.680724 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c7de82e6-844a-4dab-b0f7-6abab4e0bb73 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:15.681479 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c7de82e6-844a-4dab-b0f7-6abab4e0bb73 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:15.681908 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-c7de82e6-844a-4dab-b0f7-6abab4e0bb73 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:15.999718 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-c7de82e6-844a-4dab-b0f7-6abab4e0bb73 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:49:16.011400 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-c7de82e6-844a-4dab-b0f7-6abab4e0bb73 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1677 microversion: 2.1 time: 0.342652 Jun 23 13:49:16.012289 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 518/1024] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:49:15 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1677 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:49:17.033185 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-d567ba57-0919-47d9-870e-8ee4f7682afb tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:49:17.034200 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-d567ba57-0919-47d9-870e-8ee4f7682afb tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:49:17.042674 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d567ba57-0919-47d9-870e-8ee4f7682afb tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:17.043131 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d567ba57-0919-47d9-870e-8ee4f7682afb tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:17.043939 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d567ba57-0919-47d9-870e-8ee4f7682afb tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:17.044382 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d567ba57-0919-47d9-870e-8ee4f7682afb tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:17.234282 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-d567ba57-0919-47d9-870e-8ee4f7682afb tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:49:17.241896 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-d567ba57-0919-47d9-870e-8ee4f7682afb tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1677 microversion: 2.1 time: 0.215370 Jun 23 13:49:17.242529 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 507/1025] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:49:17 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1677 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:49:18.262765 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-d6bf0107-96a6-4c95-a6e3-1cf020f1436f tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:49:18.263954 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-d6bf0107-96a6-4c95-a6e3-1cf020f1436f tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:49:18.275177 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d6bf0107-96a6-4c95-a6e3-1cf020f1436f tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:18.275716 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d6bf0107-96a6-4c95-a6e3-1cf020f1436f tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:18.276502 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d6bf0107-96a6-4c95-a6e3-1cf020f1436f tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:18.276938 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-d6bf0107-96a6-4c95-a6e3-1cf020f1436f tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:18.415738 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-d6bf0107-96a6-4c95-a6e3-1cf020f1436f tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:49:18.423890 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-d6bf0107-96a6-4c95-a6e3-1cf020f1436f tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1677 microversion: 2.1 time: 0.167735 Jun 23 13:49:18.424461 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 519/1026] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:49:18 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:49:19.445383 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-f9f121ef-4628-4470-8a13-0a80d6c2d4f3 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:49:19.446095 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-f9f121ef-4628-4470-8a13-0a80d6c2d4f3 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:49:19.454685 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f9f121ef-4628-4470-8a13-0a80d6c2d4f3 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:19.455221 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f9f121ef-4628-4470-8a13-0a80d6c2d4f3 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:19.456171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f9f121ef-4628-4470-8a13-0a80d6c2d4f3 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:19.456696 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f9f121ef-4628-4470-8a13-0a80d6c2d4f3 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:19.599672 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-f9f121ef-4628-4470-8a13-0a80d6c2d4f3 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:49:19.607328 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-f9f121ef-4628-4470-8a13-0a80d6c2d4f3 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1654 microversion: 2.1 time: 0.168561 Jun 23 13:49:19.607928 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 508/1027] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:49:19 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1654 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:49:19.628818 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-32e9206d-d9ce-49e4-90dd-321b1f08b5f2 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:49:19.639159 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-32e9206d-d9ce-49e4-90dd-321b1f08b5f2 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:19.639857 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-32e9206d-d9ce-49e4-90dd-321b1f08b5f2 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:19.665118 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-32e9206d-d9ce-49e4-90dd-321b1f08b5f2 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Going to try to start instance {{(pid=134667) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 23 13:49:19.718729 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-32e9206d-d9ce-49e4-90dd-321b1f08b5f2 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "POST /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a/action" status: 202 len: 0 microversion: 2.1 time: 0.097390 Jun 23 13:49:19.719288 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 520/1028] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Jun 23 13:49:19 2022] POST /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 13:49:19.728176 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-f449dfa6-f7bd-475f-be7e-138930e6bdd2 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:49:19.728795 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-f449dfa6-f7bd-475f-be7e-138930e6bdd2 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:49:19.735221 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f449dfa6-f7bd-475f-be7e-138930e6bdd2 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:19.735835 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f449dfa6-f7bd-475f-be7e-138930e6bdd2 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:19.736967 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f449dfa6-f7bd-475f-be7e-138930e6bdd2 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:19.737530 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f449dfa6-f7bd-475f-be7e-138930e6bdd2 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:19.873760 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-f449dfa6-f7bd-475f-be7e-138930e6bdd2 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:49:19.881621 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-f449dfa6-f7bd-475f-be7e-138930e6bdd2 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1663 microversion: 2.1 time: 0.158110 Jun 23 13:49:19.882199 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 509/1029] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:49:19 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1663 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:49:20.904540 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-fd83bfcc-d824-49b9-9bd6-85a42da53e58 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:49:20.905746 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-fd83bfcc-d824-49b9-9bd6-85a42da53e58 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:49:20.915890 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fd83bfcc-d824-49b9-9bd6-85a42da53e58 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:20.916341 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fd83bfcc-d824-49b9-9bd6-85a42da53e58 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:20.917104 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fd83bfcc-d824-49b9-9bd6-85a42da53e58 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:20.917536 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-fd83bfcc-d824-49b9-9bd6-85a42da53e58 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:21.054601 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-fd83bfcc-d824-49b9-9bd6-85a42da53e58 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:49:21.066490 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-fd83bfcc-d824-49b9-9bd6-85a42da53e58 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1663 microversion: 2.1 time: 0.168841 Jun 23 13:49:21.067282 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 521/1030] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:49:20 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1663 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:49:22.088211 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c69c5b7c-197a-4657-8e5b-65467f4a169c tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:49:22.088864 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-c69c5b7c-197a-4657-8e5b-65467f4a169c tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:49:22.096549 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c69c5b7c-197a-4657-8e5b-65467f4a169c tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:22.097056 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c69c5b7c-197a-4657-8e5b-65467f4a169c tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:22.097913 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c69c5b7c-197a-4657-8e5b-65467f4a169c tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:22.098401 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c69c5b7c-197a-4657-8e5b-65467f4a169c tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:22.229488 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-c69c5b7c-197a-4657-8e5b-65467f4a169c tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:49:22.237420 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-c69c5b7c-197a-4657-8e5b-65467f4a169c tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1667 microversion: 2.1 time: 0.154872 Jun 23 13:49:22.237986 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 510/1031] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:49:22 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1667 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:49:33.893532 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 13:49:33.894687 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Thu Jun 23 13:49:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 13:49:34.620932 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 13:49:34.621615 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Thu Jun 23 13:49:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 13:49:54.491982 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-f89f7bab-6eb9-474e-a218-64c85d7dbd3f tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:49:54.493107 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-f89f7bab-6eb9-474e-a218-64c85d7dbd3f tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:49:54.495316 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_api:SELECT=16 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:54.496015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:54.502061 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f89f7bab-6eb9-474e-a218-64c85d7dbd3f tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:54.502510 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f89f7bab-6eb9-474e-a218-64c85d7dbd3f tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:54.503287 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f89f7bab-6eb9-474e-a218-64c85d7dbd3f tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:54.503759 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f89f7bab-6eb9-474e-a218-64c85d7dbd3f tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:54.535203 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-f89f7bab-6eb9-474e-a218-64c85d7dbd3f tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050082 Jun 23 13:49:54.535823 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 522/1032] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Jun 23 13:49:54 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 13:49:54.602694 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-be81da29-3f53-444f-850e-c6b75f9304d9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:49:54.603210 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-be81da29-3f53-444f-850e-c6b75f9304d9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:49:54.605340 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_api:SELECT=16 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:54.606010 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:49:54.612288 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-be81da29-3f53-444f-850e-c6b75f9304d9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:54.612745 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-be81da29-3f53-444f-850e-c6b75f9304d9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:54.613521 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-be81da29-3f53-444f-850e-c6b75f9304d9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:54.613952 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-be81da29-3f53-444f-850e-c6b75f9304d9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:54.645412 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-be81da29-3f53-444f-850e-c6b75f9304d9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Going to try to terminate instance {{(pid=134666) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 13:49:54.728348 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-be81da29-3f53-444f-850e-c6b75f9304d9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 204 len: 0 microversion: 2.1 time: 0.129266 Jun 23 13:49:54.729294 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 511/1033] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Jun 23 13:49:54 2022] DELETE /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 13:49:54.738405 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-8ce46b81-d009-4151-bb8e-86587523ba4c tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:49:54.739197 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-8ce46b81-d009-4151-bb8e-86587523ba4c tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:49:54.746496 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8ce46b81-d009-4151-bb8e-86587523ba4c tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:54.746999 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8ce46b81-d009-4151-bb8e-86587523ba4c tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:54.747837 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8ce46b81-d009-4151-bb8e-86587523ba4c tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:54.748336 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8ce46b81-d009-4151-bb8e-86587523ba4c tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:54.892746 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-8ce46b81-d009-4151-bb8e-86587523ba4c tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:49:54.902995 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-8ce46b81-d009-4151-bb8e-86587523ba4c tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1673 microversion: 2.1 time: 0.169510 Jun 23 13:49:54.903594 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 523/1034] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:49:54 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:49:55.932013 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-0a964aa7-0ecb-4004-9a49-cedd265928d3 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:49:55.933154 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-0a964aa7-0ecb-4004-9a49-cedd265928d3 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:49:55.944122 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0a964aa7-0ecb-4004-9a49-cedd265928d3 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:55.944870 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0a964aa7-0ecb-4004-9a49-cedd265928d3 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:55.946114 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0a964aa7-0ecb-4004-9a49-cedd265928d3 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:55.946831 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0a964aa7-0ecb-4004-9a49-cedd265928d3 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:56.085296 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-0a964aa7-0ecb-4004-9a49-cedd265928d3 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:49:56.093038 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-0a964aa7-0ecb-4004-9a49-cedd265928d3 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1673 microversion: 2.1 time: 0.168173 Jun 23 13:49:56.093595 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 512/1035] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:49:55 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:49:57.110217 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-f55080d1-41db-41ee-920b-24ef78e2cfa7 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:49:57.110905 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-f55080d1-41db-41ee-920b-24ef78e2cfa7 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:49:57.117447 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f55080d1-41db-41ee-920b-24ef78e2cfa7 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:57.117900 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f55080d1-41db-41ee-920b-24ef78e2cfa7 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:57.118671 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f55080d1-41db-41ee-920b-24ef78e2cfa7 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:57.119120 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f55080d1-41db-41ee-920b-24ef78e2cfa7 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:57.182885 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-f55080d1-41db-41ee-920b-24ef78e2cfa7 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:49:57.190953 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-f55080d1-41db-41ee-920b-24ef78e2cfa7 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 200 len: 1605 microversion: 2.1 time: 0.084523 Jun 23 13:49:57.191537 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 524/1036] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:49:57 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 1605 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:49:57.801948 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-a703154b-2735-4ded-9750-dfbdcea1739b req-8cd154a5-f905-4b71-b91e-5d4a83ad18c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a45e14a5-376a-40fb-8ea0-934aa3de116a", "name": "network-vif-deleted", "tag": "05ad5662-9e88-4d0d-aecc-58d0f3be244c"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:49:57.813199 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-a703154b-2735-4ded-9750-dfbdcea1739b req-8cd154a5-f905-4b71-b91e-5d4a83ad18c5 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:57.814077 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-a703154b-2735-4ded-9750-dfbdcea1739b req-8cd154a5-f905-4b71-b91e-5d4a83ad18c5 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:57.832126 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-a703154b-2735-4ded-9750-dfbdcea1739b req-8cd154a5-f905-4b71-b91e-5d4a83ad18c5 service nova] Creating event network-vif-deleted:05ad5662-9e88-4d0d-aecc-58d0f3be244c for instance a45e14a5-376a-40fb-8ea0-934aa3de116a on hv-cinder-81558 Jun 23 13:49:57.838414 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-a703154b-2735-4ded-9750-dfbdcea1739b req-8cd154a5-f905-4b71-b91e-5d4a83ad18c5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107473 Jun 23 13:49:57.839078 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 513/1037] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:49:58.208961 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-f6df8f61-7c93-462b-a8f0-1d5b0a6fa7c9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:49:58.210540 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-f6df8f61-7c93-462b-a8f0-1d5b0a6fa7c9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:49:58.219621 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f6df8f61-7c93-462b-a8f0-1d5b0a6fa7c9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:58.220070 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f6df8f61-7c93-462b-a8f0-1d5b0a6fa7c9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:58.220877 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f6df8f61-7c93-462b-a8f0-1d5b0a6fa7c9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:49:58.221311 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f6df8f61-7c93-462b-a8f0-1d5b0a6fa7c9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:49:58.235161 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.wsgi [None req-f6df8f61-7c93-462b-a8f0-1d5b0a6fa7c9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] HTTP exception thrown: Instance a45e14a5-376a-40fb-8ea0-934aa3de116a could not be found. Jun 23 13:49:58.236881 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-f6df8f61-7c93-462b-a8f0-1d5b0a6fa7c9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Request method failure captured: Jun 23 13:49:58.236881 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a HTTP/1.1 Jun 23 13:49:58.236881 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:49:58.236881 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:49:58.236881 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:49:58.236881 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 0 Jun 23 13:49:58.236881 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:49:58.236881 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:49:58.236881 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:49:58.236881 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:49:58.236881 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitG7UurDz-KPsa8stkrVU0vZYzsnANg635YiLVe5U6Qbpk9FsYPz82vXWs-suucGK83rFNf_tPooVx7Ro49zZT4PCS3PHfs7ce1Bj2P0U96tXFPhBuJHhKhrnqhvzWVcHgbm1k0WlELAE8RF18zQuqmlIzGjgiu7j6Jup0GRX58bOZfs Jun 23 13:49:58.236881 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:49:58.236881 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:49:58.236881 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:49:58.236881 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:49:58.236881 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:49:58.236881 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:49:58.236881 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: f9d1fbb158dc4d63a7aeb04d115f7636 Jun 23 13:49:58.236881 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-AttachVolumeTestJSON-1773703291 Jun 23 13:49:58.236881 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:49:58.236881 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:49:58.238583 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f9d1fbb158dc4d63a7aeb04d115f7636"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9d1fbb158dc4d63a7aeb04d115f7636"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9d1fbb158dc4d63a7aeb04d115f7636"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f9d1fbb158dc4d63a7aeb04d115f7636", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:49:58.238583 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-AttachVolumeTestJSON-1773703291 Jun 23 13:49:58.238583 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: f9d1fbb158dc4d63a7aeb04d115f7636 Jun 23 13:49:58.238583 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1773703291 Jun 23 13:49:58.238583 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-AttachVolumeTestJSON-1773703291-project Jun 23 13:49:58.238583 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:49:58.238583 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:49:58.238583 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: 2754a81c57c249cfa1bc9f0eb08e4dac Jun 23 13:49:58.238583 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-AttachVolumeTestJSON-1773703291-project Jun 23 13:49:58.238583 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: > Jun 23 13:49:58.238583 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Instance a45e14a5-376a-40fb-8ea0-934aa3de116a could not be found. Jun 23 13:49:58.238583 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'id': 'a45e14a5-376a-40fb-8ea0-934aa3de116a'} Jun 23 13:49:58.239487 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:49:58.239487 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:49:58.239487 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:49:58.239487 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:49:58.239487 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:49:58.239487 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:49:58.239487 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:49:58.239487 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:49:58.239487 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:49:58.239487 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:49:58.239487 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a45e14a5-376a-40fb-8ea0-934aa3de116a could not be found. Jun 23 13:49:58.239487 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:49:58.239487 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:49:58.239487 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:49:58.239487 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:49:58.239487 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:49:58.239487 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:49:58.239487 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:49:58.239487 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:49:58.239487 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:49:58.240831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:49:58.240831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:49:58.240831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:49:58.240831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:49:58.240831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:49:58.240831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:49:58.240831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:49:58.240831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a45e14a5-376a-40fb-8ea0-934aa3de116a could not be found. Jun 23 13:49:58.240831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:49:58.240831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:49:58.240831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:49:58.240831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:49:58.240831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:49:58.240831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:49:58.240831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:49:58.240831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:49:58.240831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a45e14a5-376a-40fb-8ea0-934aa3de116a could not be found. Jun 23 13:49:58.240831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:49:58.242017 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-f6df8f61-7c93-462b-a8f0-1d5b0a6fa7c9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Returning 404 to user: Instance a45e14a5-376a-40fb-8ea0-934aa3de116a could not be found. {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:49:58.242017 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-f6df8f61-7c93-462b-a8f0-1d5b0a6fa7c9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 404 len: 111 microversion: 2.1 time: 0.033597 Jun 23 13:49:58.242017 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 525/1038] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:49:58 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:49:58.247718 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-32ae3f41-eae6-4499-a7f4-8b7631897315 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '.version_select at 0x7fd7724f93a0>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:49:58.271244 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-32ae3f41-eae6-4499-a7f4-8b7631897315 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1107468320" status: 202 len: 0 microversion: 2.1 time: 0.027493 Jun 23 13:49:58.271818 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 514/1039] 10.222.0.26 () {58 vars in 1220 bytes} [Thu Jun 23 13:49:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1107468320 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 13:49:58.905660 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-bec4de22-c1e3-4698-a4c6-fe841e674374 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Action: 'create', calling method: .version_select at 0x7fd77274e040>, body: {"keypair": {"name": "tempest-keypair-571269994", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKURwbadRMcgn+qgPJYDEfngIaehjTeFDq/pEGa5iMM1ABXnxJY961T1TXBumhn+rlaE9R5BBH6p4Wgkr/QxSFPbKFg7n7qxw2Mi1rFNtTxmm22SvWHcJ3ZACfKLEpR2A=="}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:49:58.919871 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.quota [None req-bec4de22-c1e3-4698-a4c6-fe841e674374 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Getting quotas for project f9d1fbb158dc4d63a7aeb04d115f7636. Resources: {'key_pairs'} {{(pid=134667) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:49:58.923717 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.quota [None req-bec4de22-c1e3-4698-a4c6-fe841e674374 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Getting quotas for user 2754a81c57c249cfa1bc9f0eb08e4dac and project f9d1fbb158dc4d63a7aeb04d115f7636. Resources: {'key_pairs'} {{(pid=134667) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:49:58.951250 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-bec4de22-c1e3-4698-a4c6-fe841e674374 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049516 Jun 23 13:49:58.951861 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 526/1040] 10.222.0.26 () {60 vars in 1158 bytes} [Thu Jun 23 13:49:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:50:00.253477 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-16319472-81fb-408c-a0b2-64d479b2a229 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-136224566", "imageRef": "dd7aacbf-3b3e-496e-967e-53d2a1b1f200", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b55fd257-6b00-49b3-a392-7cc3edf381f1"}], "security_groups": [{"name": "tempest-securitygroup--407585134"}], "key_name": "tempest-keypair-571269994", "user_data": "}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:50:00.360678 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.network.neutron [None req-16319472-81fb-408c-a0b2-64d479b2a229 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] validate_networks() for [('b55fd257-6b00-49b3-a392-7cc3edf381f1', None, None, None, None, None)] {{(pid=134666) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 13:50:00.808756 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-16319472-81fb-408c-a0b2-64d479b2a229 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Flavor limits 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 13:50:00.809453 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-16319472-81fb-408c-a0b2-64d479b2a229 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Image limits 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 13:50:00.810348 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-16319472-81fb-408c-a0b2-64d479b2a229 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Flavor pref 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 13:50:00.810758 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-16319472-81fb-408c-a0b2-64d479b2a229 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Image pref 0:0:0 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 13:50:00.811174 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.virt.hardware [None req-16319472-81fb-408c-a0b2-64d479b2a229 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=134666) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 13:50:00.820722 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-16319472-81fb-408c-a0b2-64d479b2a229 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:00.821192 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-16319472-81fb-408c-a0b2-64d479b2a229 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:00.821971 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-16319472-81fb-408c-a0b2-64d479b2a229 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:00.822407 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-16319472-81fb-408c-a0b2-64d479b2a229 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:00.840169 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-16319472-81fb-408c-a0b2-64d479b2a229 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Getting quotas for project f9d1fbb158dc4d63a7aeb04d115f7636. Resources: {'ram', 'cores', 'instances'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 13:50:00.844534 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.quota [None req-16319472-81fb-408c-a0b2-64d479b2a229 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Getting quotas for user 2754a81c57c249cfa1bc9f0eb08e4dac and project f9d1fbb158dc4d63a7aeb04d115f7636. Resources: {'ram', 'cores', 'instances'} {{(pid=134666) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 13:50:00.855708 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-16319472-81fb-408c-a0b2-64d479b2a229 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Going to run 1 instances... {{(pid=134666) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 13:50:00.858048 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-16319472-81fb-408c-a0b2-64d479b2a229 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd7aacbf-3b3e-496e-967e-53d2a1b1f200',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=134666) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 13:50:00.907653 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-16319472-81fb-408c-a0b2-64d479b2a229 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.658933 Jun 23 13:50:00.908494 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 515/1041] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Jun 23 13:50:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 13:50:00.918998 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-dd83e242-ad42-4fa7-a140-69bf8c04da32 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:50:00.919853 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-dd83e242-ad42-4fa7-a140-69bf8c04da32 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:50:00.974238 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-dd83e242-ad42-4fa7-a140-69bf8c04da32 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:50:00.981033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-dd83e242-ad42-4fa7-a140-69bf8c04da32 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641" status: 200 len: 1236 microversion: 2.1 time: 0.066457 Jun 23 13:50:00.981805 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 527/1042] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:50:00 2022] GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641 => generated 1236 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 13:50:02.001611 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-60fe974b-0fe9-4604-8d88-890662a6c242 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:50:02.002484 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-60fe974b-0fe9-4604-8d88-890662a6c242 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:50:02.009558 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-60fe974b-0fe9-4604-8d88-890662a6c242 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:02.010230 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-60fe974b-0fe9-4604-8d88-890662a6c242 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:02.011163 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-60fe974b-0fe9-4604-8d88-890662a6c242 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:02.011778 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-60fe974b-0fe9-4604-8d88-890662a6c242 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:02.087154 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-60fe974b-0fe9-4604-8d88-890662a6c242 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:50:02.099753 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-60fe974b-0fe9-4604-8d88-890662a6c242 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641" status: 200 len: 1306 microversion: 2.1 time: 0.105200 Jun 23 13:50:02.100468 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 516/1043] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:50:01 2022] GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641 => generated 1306 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:50:03.117087 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-8414d360-04c5-4f48-8ed6-36ba80277217 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:50:03.117687 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-8414d360-04c5-4f48-8ed6-36ba80277217 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:50:03.124699 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8414d360-04c5-4f48-8ed6-36ba80277217 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:03.125139 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8414d360-04c5-4f48-8ed6-36ba80277217 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:03.125918 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8414d360-04c5-4f48-8ed6-36ba80277217 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:03.126572 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8414d360-04c5-4f48-8ed6-36ba80277217 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:03.282094 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-8414d360-04c5-4f48-8ed6-36ba80277217 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:50:03.289973 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-8414d360-04c5-4f48-8ed6-36ba80277217 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641" status: 200 len: 1361 microversion: 2.1 time: 0.176831 Jun 23 13:50:03.290556 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 528/1044] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:50:03 2022] GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641 => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:50:03.366349 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-3662fc12-40ca-4e1f-810c-fa1a1b84af05 req-0faddc59-d115-4967-82ae-d15306958973 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3773db2f-4a1a-4a07-bb0f-f30771aac641", "tag": "8ed184ed-283e-4add-9846-2ecc4c944c3e"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:50:03.381394 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-3662fc12-40ca-4e1f-810c-fa1a1b84af05 req-0faddc59-d115-4967-82ae-d15306958973 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:03.382610 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-3662fc12-40ca-4e1f-810c-fa1a1b84af05 req-0faddc59-d115-4967-82ae-d15306958973 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:03.397068 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-3662fc12-40ca-4e1f-810c-fa1a1b84af05 req-0faddc59-d115-4967-82ae-d15306958973 service nova] Creating event network-changed:8ed184ed-283e-4add-9846-2ecc4c944c3e for instance 3773db2f-4a1a-4a07-bb0f-f30771aac641 on hv-cinder-81558 Jun 23 13:50:03.402895 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-3662fc12-40ca-4e1f-810c-fa1a1b84af05 req-0faddc59-d115-4967-82ae-d15306958973 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041853 Jun 23 13:50:03.404012 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 517/1045] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:50:04.311619 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-45c4d607-16f8-4fc9-8f03-4071a8d9c4e9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:50:04.312477 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-45c4d607-16f8-4fc9-8f03-4071a8d9c4e9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:50:04.323525 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-45c4d607-16f8-4fc9-8f03-4071a8d9c4e9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:04.324273 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-45c4d607-16f8-4fc9-8f03-4071a8d9c4e9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:04.325528 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-45c4d607-16f8-4fc9-8f03-4071a8d9c4e9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:04.326284 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-45c4d607-16f8-4fc9-8f03-4071a8d9c4e9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:04.460489 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-45c4d607-16f8-4fc9-8f03-4071a8d9c4e9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:50:04.468544 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-45c4d607-16f8-4fc9-8f03-4071a8d9c4e9 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641" status: 200 len: 1361 microversion: 2.1 time: 0.163924 Jun 23 13:50:04.469128 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 529/1046] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:50:04 2022] GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:50:05.491188 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-fbabb7e4-889c-4247-b636-b0a006afd337 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:50:05.492388 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-fbabb7e4-889c-4247-b636-b0a006afd337 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:50:05.501055 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fbabb7e4-889c-4247-b636-b0a006afd337 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:05.501507 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fbabb7e4-889c-4247-b636-b0a006afd337 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:05.502273 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fbabb7e4-889c-4247-b636-b0a006afd337 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:05.502708 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fbabb7e4-889c-4247-b636-b0a006afd337 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:05.642842 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-fbabb7e4-889c-4247-b636-b0a006afd337 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:50:05.650607 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-fbabb7e4-889c-4247-b636-b0a006afd337 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641" status: 200 len: 1361 microversion: 2.1 time: 0.167325 Jun 23 13:50:05.651148 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 518/1047] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:50:05 2022] GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:50:06.671233 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-a0ed906c-7650-4377-b026-df9ab07af83b tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:50:06.671893 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-a0ed906c-7650-4377-b026-df9ab07af83b tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:50:06.678549 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a0ed906c-7650-4377-b026-df9ab07af83b tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:06.678999 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a0ed906c-7650-4377-b026-df9ab07af83b tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:06.679772 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a0ed906c-7650-4377-b026-df9ab07af83b tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:06.680211 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-a0ed906c-7650-4377-b026-df9ab07af83b tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:06.811181 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-a0ed906c-7650-4377-b026-df9ab07af83b tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:50:06.823184 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-a0ed906c-7650-4377-b026-df9ab07af83b tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641" status: 200 len: 1361 microversion: 2.1 time: 0.157933 Jun 23 13:50:06.824127 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 530/1048] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:50:06 2022] GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:50:07.849079 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c8e6f12c-909a-45a7-98de-cefcd19db4b8 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:50:07.850074 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-c8e6f12c-909a-45a7-98de-cefcd19db4b8 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:50:07.859910 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c8e6f12c-909a-45a7-98de-cefcd19db4b8 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:07.860360 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c8e6f12c-909a-45a7-98de-cefcd19db4b8 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:07.861116 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c8e6f12c-909a-45a7-98de-cefcd19db4b8 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:07.861548 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c8e6f12c-909a-45a7-98de-cefcd19db4b8 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:07.989694 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-c8e6f12c-909a-45a7-98de-cefcd19db4b8 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:50:07.997521 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-c8e6f12c-909a-45a7-98de-cefcd19db4b8 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641" status: 200 len: 1361 microversion: 2.1 time: 0.155127 Jun 23 13:50:07.998085 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 519/1049] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:50:07 2022] GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:50:09.014112 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-e03cf391-0e4f-41af-becb-6adfc723b904 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:50:09.014749 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-e03cf391-0e4f-41af-becb-6adfc723b904 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:50:09.021635 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e03cf391-0e4f-41af-becb-6adfc723b904 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:09.022082 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e03cf391-0e4f-41af-becb-6adfc723b904 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:09.022848 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e03cf391-0e4f-41af-becb-6adfc723b904 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:09.023286 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-e03cf391-0e4f-41af-becb-6adfc723b904 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:09.176044 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-e03cf391-0e4f-41af-becb-6adfc723b904 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:50:09.183985 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-e03cf391-0e4f-41af-becb-6adfc723b904 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641" status: 200 len: 1361 microversion: 2.1 time: 0.173789 Jun 23 13:50:09.184957 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 531/1050] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:50:09 2022] GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641 => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:50:09.271099 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-c046d218-a7d4-40e5-b72a-cc9b17a5930c req-d3032c1a-00d4-42fb-9e48-61595b9a6237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3773db2f-4a1a-4a07-bb0f-f30771aac641", "name": "network-vif-plugged", "status": "completed", "tag": "8ed184ed-283e-4add-9846-2ecc4c944c3e"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:50:09.279280 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-c046d218-a7d4-40e5-b72a-cc9b17a5930c req-d3032c1a-00d4-42fb-9e48-61595b9a6237 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:09.279806 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-c046d218-a7d4-40e5-b72a-cc9b17a5930c req-d3032c1a-00d4-42fb-9e48-61595b9a6237 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:09.291785 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-c046d218-a7d4-40e5-b72a-cc9b17a5930c req-d3032c1a-00d4-42fb-9e48-61595b9a6237 service nova] Creating event network-vif-plugged:8ed184ed-283e-4add-9846-2ecc4c944c3e for instance 3773db2f-4a1a-4a07-bb0f-f30771aac641 on hv-cinder-81558 Jun 23 13:50:09.296875 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-c046d218-a7d4-40e5-b72a-cc9b17a5930c req-d3032c1a-00d4-42fb-9e48-61595b9a6237 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088801 Jun 23 13:50:09.297535 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 520/1051] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:50:09.324477 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-ae730db7-9672-4dc4-9bfe-43488a863f4e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:50:09.324744 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-ae730db7-9672-4dc4-9bfe-43488a863f4e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 02fa04ed-3477-423e-b4bc-2a860638bd30] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:50:09.331747 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ae730db7-9672-4dc4-9bfe-43488a863f4e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:09.332435 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ae730db7-9672-4dc4-9bfe-43488a863f4e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:09.332572 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-dc52d8c7-ff50-40f0-bfba-5987ed714feb req-d2021064-2e8c-4c1c-b8fb-7d1a67059154 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02fa04ed-3477-423e-b4bc-2a860638bd30", "tag": "3e3135bb-5e40-457d-b725-fb3c8289323a"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:50:09.333520 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ae730db7-9672-4dc4-9bfe-43488a863f4e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:09.333961 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-ae730db7-9672-4dc4-9bfe-43488a863f4e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:09.341434 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-dc52d8c7-ff50-40f0-bfba-5987ed714feb req-d2021064-2e8c-4c1c-b8fb-7d1a67059154 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:09.342128 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-dc52d8c7-ff50-40f0-bfba-5987ed714feb req-d2021064-2e8c-4c1c-b8fb-7d1a67059154 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:09.353938 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-dc52d8c7-ff50-40f0-bfba-5987ed714feb req-d2021064-2e8c-4c1c-b8fb-7d1a67059154 service nova] Creating event network-changed:3e3135bb-5e40-457d-b725-fb3c8289323a for instance 02fa04ed-3477-423e-b4bc-2a860638bd30 on hv-cinder-81558 Jun 23 13:50:09.359545 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-dc52d8c7-ff50-40f0-bfba-5987ed714feb req-d2021064-2e8c-4c1c-b8fb-7d1a67059154 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031351 Jun 23 13:50:09.360690 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 521/1052] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 13:50:09.365981 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-ae730db7-9672-4dc4-9bfe-43488a863f4e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 02fa04ed-3477-423e-b4bc-2a860638bd30] Going to try to terminate instance {{(pid=134667) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 13:50:09.462786 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-ae730db7-9672-4dc4-9bfe-43488a863f4e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "DELETE /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30" status: 204 len: 0 microversion: 2.1 time: 0.142136 Jun 23 13:50:09.463786 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 532/1053] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Jun 23 13:50:09 2022] DELETE /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 13:50:09.475120 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-41ce89af-baa7-46ea-bcd8-eb50996e7080 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:50:09.475878 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-41ce89af-baa7-46ea-bcd8-eb50996e7080 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 02fa04ed-3477-423e-b4bc-2a860638bd30] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:50:09.482770 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-41ce89af-baa7-46ea-bcd8-eb50996e7080 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:09.483541 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-41ce89af-baa7-46ea-bcd8-eb50996e7080 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:09.484639 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-41ce89af-baa7-46ea-bcd8-eb50996e7080 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:09.485259 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-41ce89af-baa7-46ea-bcd8-eb50996e7080 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:09.629140 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-41ce89af-baa7-46ea-bcd8-eb50996e7080 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:50:09.637162 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-41ce89af-baa7-46ea-bcd8-eb50996e7080 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30" status: 200 len: 1577 microversion: 2.1 time: 0.168605 Jun 23 13:50:09.637812 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 522/1054] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:50:09 2022] GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30 => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:50:10.201934 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-bd3c02f0-7840-4e24-a47d-741c0d7f0e64 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:50:10.202691 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-bd3c02f0-7840-4e24-a47d-741c0d7f0e64 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:50:10.210083 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bd3c02f0-7840-4e24-a47d-741c0d7f0e64 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:10.210503 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bd3c02f0-7840-4e24-a47d-741c0d7f0e64 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:10.211366 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bd3c02f0-7840-4e24-a47d-741c0d7f0e64 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:10.211745 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bd3c02f0-7840-4e24-a47d-741c0d7f0e64 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:10.349261 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-bd3c02f0-7840-4e24-a47d-741c0d7f0e64 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:50:10.357198 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-bd3c02f0-7840-4e24-a47d-741c0d7f0e64 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641" status: 200 len: 1361 microversion: 2.1 time: 0.159549 Jun 23 13:50:10.357826 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 533/1055] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:50:10 2022] GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:50:10.654438 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-f53d98df-2590-4107-b780-fd58e95362ca tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:50:10.655282 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-f53d98df-2590-4107-b780-fd58e95362ca tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 02fa04ed-3477-423e-b4bc-2a860638bd30] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:50:10.662541 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f53d98df-2590-4107-b780-fd58e95362ca tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:10.663000 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f53d98df-2590-4107-b780-fd58e95362ca tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:10.663820 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f53d98df-2590-4107-b780-fd58e95362ca tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:10.664253 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-f53d98df-2590-4107-b780-fd58e95362ca tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:10.804242 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-f53d98df-2590-4107-b780-fd58e95362ca tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:50:10.812659 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-f53d98df-2590-4107-b780-fd58e95362ca tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30" status: 200 len: 1577 microversion: 2.1 time: 0.162116 Jun 23 13:50:10.813240 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 523/1056] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:50:10 2022] GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:50:11.374302 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-0785c140-63a9-4438-8f91-9b51bf7fe284 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:50:11.374939 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-0785c140-63a9-4438-8f91-9b51bf7fe284 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:50:11.377012 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell0:SELECT=6 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:11.383739 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0785c140-63a9-4438-8f91-9b51bf7fe284 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:11.384217 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0785c140-63a9-4438-8f91-9b51bf7fe284 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:11.385066 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0785c140-63a9-4438-8f91-9b51bf7fe284 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:11.385488 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-0785c140-63a9-4438-8f91-9b51bf7fe284 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:11.520101 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-0785c140-63a9-4438-8f91-9b51bf7fe284 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:50:11.527858 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-0785c140-63a9-4438-8f91-9b51bf7fe284 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641" status: 200 len: 1361 microversion: 2.1 time: 0.157483 Jun 23 13:50:11.528406 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 534/1057] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:50:11 2022] GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:50:11.794686 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-98dce5cf-8782-4533-b466-87b88b1d54a3 req-c461adde-1d4f-40b1-a651-2ad2137fda33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02fa04ed-3477-423e-b4bc-2a860638bd30", "name": "network-vif-deleted", "tag": "3e3135bb-5e40-457d-b725-fb3c8289323a"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:50:11.798559 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell0:SELECT=2 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:11.799288 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell0:SELECT=6 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:11.806124 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-98dce5cf-8782-4533-b466-87b88b1d54a3 req-c461adde-1d4f-40b1-a651-2ad2137fda33 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:11.806571 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-98dce5cf-8782-4533-b466-87b88b1d54a3 req-c461adde-1d4f-40b1-a651-2ad2137fda33 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:11.817380 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-98dce5cf-8782-4533-b466-87b88b1d54a3 req-c461adde-1d4f-40b1-a651-2ad2137fda33 service nova] Creating event network-vif-deleted:3e3135bb-5e40-457d-b725-fb3c8289323a for instance 02fa04ed-3477-423e-b4bc-2a860638bd30 on hv-cinder-81558 Jun 23 13:50:11.822176 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-98dce5cf-8782-4533-b466-87b88b1d54a3 req-c461adde-1d4f-40b1-a651-2ad2137fda33 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031210 Jun 23 13:50:11.822797 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 524/1058] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:50:11.834415 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-8aec4fb5-ba55-4f41-b267-b28316ebcb98 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:50:11.835523 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-8aec4fb5-ba55-4f41-b267-b28316ebcb98 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 02fa04ed-3477-423e-b4bc-2a860638bd30] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:50:11.846027 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8aec4fb5-ba55-4f41-b267-b28316ebcb98 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:11.847369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8aec4fb5-ba55-4f41-b267-b28316ebcb98 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:11.848270 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8aec4fb5-ba55-4f41-b267-b28316ebcb98 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:11.848805 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-8aec4fb5-ba55-4f41-b267-b28316ebcb98 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:11.910474 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-8aec4fb5-ba55-4f41-b267-b28316ebcb98 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:50:11.918177 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-8aec4fb5-ba55-4f41-b267-b28316ebcb98 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30" status: 200 len: 1226 microversion: 2.1 time: 0.091394 Jun 23 13:50:11.918719 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 535/1059] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:50:11 2022] GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:50:12.545495 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c3d21870-c541-460d-9a77-1040b56bc9ab tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:50:12.546171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-c3d21870-c541-460d-9a77-1040b56bc9ab tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:50:12.552796 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c3d21870-c541-460d-9a77-1040b56bc9ab tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:12.553252 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c3d21870-c541-460d-9a77-1040b56bc9ab tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:12.554013 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c3d21870-c541-460d-9a77-1040b56bc9ab tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:12.554450 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c3d21870-c541-460d-9a77-1040b56bc9ab tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:12.692636 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-c3d21870-c541-460d-9a77-1040b56bc9ab tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:50:12.700472 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-c3d21870-c541-460d-9a77-1040b56bc9ab tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641" status: 200 len: 1547 microversion: 2.1 time: 0.159233 Jun 23 13:50:12.701009 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 525/1060] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:50:12 2022] GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641 => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:50:12.717565 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-f7d18d02-4e60-45e5-8613-61bacdcfd994 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:50:12.718107 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-f7d18d02-4e60-45e5-8613-61bacdcfd994 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:50:12.727050 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f7d18d02-4e60-45e5-8613-61bacdcfd994 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:12.728041 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f7d18d02-4e60-45e5-8613-61bacdcfd994 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:12.729307 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f7d18d02-4e60-45e5-8613-61bacdcfd994 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:12.730074 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-f7d18d02-4e60-45e5-8613-61bacdcfd994 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:12.817939 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-f7d18d02-4e60-45e5-8613-61bacdcfd994 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103885 Jun 23 13:50:12.818889 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 536/1061] 10.222.0.26 () {58 vars in 1274 bytes} [Thu Jun 23 13:50:12 2022] GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:50:12.934514 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-a20dd4e5-ba66-4911-ac35-72badb1e80f6 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:50:12.935801 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-a20dd4e5-ba66-4911-ac35-72badb1e80f6 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 02fa04ed-3477-423e-b4bc-2a860638bd30] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:50:12.942930 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a20dd4e5-ba66-4911-ac35-72badb1e80f6 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:12.943699 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a20dd4e5-ba66-4911-ac35-72badb1e80f6 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:12.944473 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a20dd4e5-ba66-4911-ac35-72badb1e80f6 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:12.945020 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a20dd4e5-ba66-4911-ac35-72badb1e80f6 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:12.978438 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a20dd4e5-ba66-4911-ac35-72badb1e80f6 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:12.978889 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a20dd4e5-ba66-4911-ac35-72badb1e80f6 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:12.979361 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.objects.instance [None req-a20dd4e5-ba66-4911-ac35-72badb1e80f6 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lazy-loading 'fault' on Instance uuid 02fa04ed-3477-423e-b4bc-2a860638bd30 {{(pid=134666) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:50:13.024236 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-a20dd4e5-ba66-4911-ac35-72badb1e80f6 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:50:13.031126 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-a20dd4e5-ba66-4911-ac35-72badb1e80f6 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30" status: 200 len: 1185 microversion: 2.1 time: 0.100449 Jun 23 13:50:13.031923 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 526/1062] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:50:12 2022] GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30 => generated 1185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:50:13.837629 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [req-f8ba137e-4916-477f-a99e-e08368b90e75 req-83798744-6a5e-4105-9ba6-73544066ae2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3773db2f-4a1a-4a07-bb0f-f30771aac641", "tag": "8ed184ed-283e-4add-9846-2ecc4c944c3e"}]} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:50:13.846037 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-f8ba137e-4916-477f-a99e-e08368b90e75 req-83798744-6a5e-4105-9ba6-73544066ae2e service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:13.846480 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [req-f8ba137e-4916-477f-a99e-e08368b90e75 req-83798744-6a5e-4105-9ba6-73544066ae2e service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:13.857811 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.compute.server_external_events [req-f8ba137e-4916-477f-a99e-e08368b90e75 req-83798744-6a5e-4105-9ba6-73544066ae2e service nova] Creating event network-changed:8ed184ed-283e-4add-9846-2ecc4c944c3e for instance 3773db2f-4a1a-4a07-bb0f-f30771aac641 on hv-cinder-81558 Jun 23 13:50:13.862785 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [req-f8ba137e-4916-477f-a99e-e08368b90e75 req-83798744-6a5e-4105-9ba6-73544066ae2e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029423 Jun 23 13:50:13.863609 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 537/1063] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:50:14.049026 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-8a8fe5fd-d32b-4f7d-9d49-f61e42191c90 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:50:14.049619 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-8a8fe5fd-d32b-4f7d-9d49-f61e42191c90 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 02fa04ed-3477-423e-b4bc-2a860638bd30] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:50:14.056859 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8a8fe5fd-d32b-4f7d-9d49-f61e42191c90 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:14.057080 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8a8fe5fd-d32b-4f7d-9d49-f61e42191c90 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:14.057720 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8a8fe5fd-d32b-4f7d-9d49-f61e42191c90 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:14.058154 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-8a8fe5fd-d32b-4f7d-9d49-f61e42191c90 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:14.072118 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.wsgi [None req-8a8fe5fd-d32b-4f7d-9d49-f61e42191c90 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] HTTP exception thrown: Instance 02fa04ed-3477-423e-b4bc-2a860638bd30 could not be found. Jun 23 13:50:14.073905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-8a8fe5fd-d32b-4f7d-9d49-f61e42191c90 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Request method failure captured: Jun 23 13:50:14.073905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: request: GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30 HTTP/1.1 Jun 23 13:50:14.073905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept: application/json Jun 23 13:50:14.073905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept-Encoding: identity Jun 23 13:50:14.073905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Connection: close Jun 23 13:50:14.073905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Length: 0 Jun 23 13:50:14.073905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Type: application/json Jun 23 13:50:14.073905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Host: 10.222.0.26 Jun 23 13:50:14.073905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Openstack-System-Scope: None Jun 23 13:50:14.073905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: User-Agent: python-urllib3/1.26.9 Jun 23 13:50:14.073905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Auth-Token: gAAAAABitG3LhHYxLw9V8q4SHO5dUJ0ZlE_I44zxSKkMSakbtRg_B1BDGNLxXvzE-VVy80jLCkdRC3l06S7zhBm8Oi4OkjoNGXcaRhMM6oj17IETDNl-rIvjYdOkoPRXCne87ZFxWkidUCT-AeZPw7Y2snKNRNW3KwjmToqlI8x2fMezG0FhYbg Jun 23 13:50:14.073905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Id: None Jun 23 13:50:14.073905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Name: None Jun 23 13:50:14.073905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Identity-Status: Confirmed Jun 23 13:50:14.073905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Is-Admin-Project: True Jun 23 13:50:14.073905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Id: default Jun 23 13:50:14.073905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Name: Default Jun 23 13:50:14.073905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Id: 0d6c438e59834c4084c818053e1fdb93 Jun 23 13:50:14.073905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Name: tempest-TestVolumeBootPattern-1088681018 Jun 23 13:50:14.073905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Role: member,reader Jun 23 13:50:14.073905 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Roles: member,reader Jun 23 13:50:14.075680 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0d6c438e59834c4084c818053e1fdb93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0d6c438e59834c4084c818053e1fdb93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0d6c438e59834c4084c818053e1fdb93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0d6c438e59834c4084c818053e1fdb93", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:50:14.075680 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant: tempest-TestVolumeBootPattern-1088681018 Jun 23 13:50:14.075680 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Id: 0d6c438e59834c4084c818053e1fdb93 Jun 23 13:50:14.075680 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Name: tempest-TestVolumeBootPattern-1088681018 Jun 23 13:50:14.075680 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User: tempest-TestVolumeBootPattern-1088681018-project Jun 23 13:50:14.075680 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Id: default Jun 23 13:50:14.075680 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Name: Default Jun 23 13:50:14.075680 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Id: 0a9f85caf65f431c96f27a7d04734211 Jun 23 13:50:14.075680 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Name: tempest-TestVolumeBootPattern-1088681018-project Jun 23 13:50:14.075680 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: method: > Jun 23 13:50:14.075680 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: exception: Instance 02fa04ed-3477-423e-b4bc-2a860638bd30 could not be found. Jun 23 13:50:14.075680 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: action_args: {'id': '02fa04ed-3477-423e-b4bc-2a860638bd30'} Jun 23 13:50:14.080485 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:50:14.080485 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:50:14.080485 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:50:14.080485 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:50:14.080485 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:50:14.080485 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:50:14.080485 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:50:14.080485 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:50:14.080485 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:50:14.080485 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:50:14.080485 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02fa04ed-3477-423e-b4bc-2a860638bd30 could not be found. Jun 23 13:50:14.080485 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:50:14.080485 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:50:14.080485 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:50:14.080485 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:50:14.080485 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:50:14.080485 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:50:14.080485 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:50:14.080485 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:50:14.080485 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:50:14.082528 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:50:14.082528 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:50:14.082528 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:50:14.082528 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:50:14.082528 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:50:14.082528 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:50:14.082528 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:50:14.082528 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02fa04ed-3477-423e-b4bc-2a860638bd30 could not be found. Jun 23 13:50:14.082528 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:50:14.082528 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:50:14.082528 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:50:14.082528 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:50:14.082528 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:50:14.082528 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:50:14.082528 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:50:14.082528 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:50:14.082528 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02fa04ed-3477-423e-b4bc-2a860638bd30 could not be found. Jun 23 13:50:14.082528 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:50:14.084621 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-8a8fe5fd-d32b-4f7d-9d49-f61e42191c90 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Returning 404 to user: Instance 02fa04ed-3477-423e-b4bc-2a860638bd30 could not be found. {{(pid=134666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:50:14.084621 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-8a8fe5fd-d32b-4f7d-9d49-f61e42191c90 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30" status: 404 len: 111 microversion: 2.1 time: 0.030581 Jun 23 13:50:14.084621 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 527/1064] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:50:14 2022] GET /compute/v2.1/servers/02fa04ed-3477-423e-b4bc-2a860638bd30 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:50:17.172329 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-6f61ce7c-0934-4999-a4b4-8230ed7df6af req-13d22070-30aa-4d72-80e0-978441cb1345 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52cbfcd2-3b2d-44f2-a44d-55ab8868fd59", "tag": "b2540c58-97f9-4f0c-98c0-3f9877fc5e17"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:50:17.177626 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-dd3773b0-ff28-4717-859e-a89c3172c4b9 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:50:17.178219 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-dd3773b0-ff28-4717-859e-a89c3172c4b9 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:50:17.185088 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-dd3773b0-ff28-4717-859e-a89c3172c4b9 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:17.185504 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-dd3773b0-ff28-4717-859e-a89c3172c4b9 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:17.186430 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-6f61ce7c-0934-4999-a4b4-8230ed7df6af req-13d22070-30aa-4d72-80e0-978441cb1345 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:17.186585 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-dd3773b0-ff28-4717-859e-a89c3172c4b9 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:17.186893 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-dd3773b0-ff28-4717-859e-a89c3172c4b9 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:17.187261 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-6f61ce7c-0934-4999-a4b4-8230ed7df6af req-13d22070-30aa-4d72-80e0-978441cb1345 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:17.198946 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-6f61ce7c-0934-4999-a4b4-8230ed7df6af req-13d22070-30aa-4d72-80e0-978441cb1345 service nova] Creating event network-changed:b2540c58-97f9-4f0c-98c0-3f9877fc5e17 for instance 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 on hv-cinder-81558 Jun 23 13:50:17.203960 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-6f61ce7c-0934-4999-a4b4-8230ed7df6af req-13d22070-30aa-4d72-80e0-978441cb1345 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035265 Jun 23 13:50:17.205489 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 528/1065] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:50:17.215861 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-dd3773b0-ff28-4717-859e-a89c3172c4b9 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59] Going to try to terminate instance {{(pid=134667) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 13:50:17.272437 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:17.306420 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-dd3773b0-ff28-4717-859e-a89c3172c4b9 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "DELETE /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59" status: 204 len: 0 microversion: 2.1 time: 0.141826 Jun 23 13:50:17.313468 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 538/1066] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Jun 23 13:50:17 2022] DELETE /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 13:50:17.322293 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-fc6f8c94-2ce7-479f-bb77-0af886cc38b8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:50:17.323128 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-fc6f8c94-2ce7-479f-bb77-0af886cc38b8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:50:17.329952 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fc6f8c94-2ce7-479f-bb77-0af886cc38b8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:17.330406 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fc6f8c94-2ce7-479f-bb77-0af886cc38b8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:17.331184 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fc6f8c94-2ce7-479f-bb77-0af886cc38b8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:17.331831 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-fc6f8c94-2ce7-479f-bb77-0af886cc38b8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:17.465966 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-fc6f8c94-2ce7-479f-bb77-0af886cc38b8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:50:17.473780 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-fc6f8c94-2ce7-479f-bb77-0af886cc38b8 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59" status: 200 len: 1575 microversion: 2.1 time: 0.155722 Jun 23 13:50:17.474365 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 529/1067] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:50:17 2022] GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:50:18.499667 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-76907cd1-f84a-43da-add3-4e932f19229b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:50:18.500672 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-76907cd1-f84a-43da-add3-4e932f19229b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:50:18.511060 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-76907cd1-f84a-43da-add3-4e932f19229b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:18.511844 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-76907cd1-f84a-43da-add3-4e932f19229b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:18.513334 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-76907cd1-f84a-43da-add3-4e932f19229b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:18.514186 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-76907cd1-f84a-43da-add3-4e932f19229b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:18.649526 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-76907cd1-f84a-43da-add3-4e932f19229b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:50:18.660940 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-76907cd1-f84a-43da-add3-4e932f19229b tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59" status: 200 len: 1575 microversion: 2.1 time: 0.171430 Jun 23 13:50:18.661709 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 539/1068] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:50:18 2022] GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:50:19.534006 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-708a05c7-4792-4dff-854a-6b3728dbcef7 req-ce191e78-bb47-4db1-9aba-12ffcc5d14f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52cbfcd2-3b2d-44f2-a44d-55ab8868fd59", "name": "network-vif-deleted", "tag": "b2540c58-97f9-4f0c-98c0-3f9877fc5e17"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:50:19.542612 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-708a05c7-4792-4dff-854a-6b3728dbcef7 req-ce191e78-bb47-4db1-9aba-12ffcc5d14f5 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:19.543035 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-708a05c7-4792-4dff-854a-6b3728dbcef7 req-ce191e78-bb47-4db1-9aba-12ffcc5d14f5 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:19.554347 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-708a05c7-4792-4dff-854a-6b3728dbcef7 req-ce191e78-bb47-4db1-9aba-12ffcc5d14f5 service nova] Creating event network-vif-deleted:b2540c58-97f9-4f0c-98c0-3f9877fc5e17 for instance 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 on hv-cinder-81558 Jun 23 13:50:19.559246 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-708a05c7-4792-4dff-854a-6b3728dbcef7 req-ce191e78-bb47-4db1-9aba-12ffcc5d14f5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028931 Jun 23 13:50:19.559841 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 530/1069] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:50:19.682092 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-df0e2c26-f7f4-4179-9926-c55db4c30f8e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:50:19.683067 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-df0e2c26-f7f4-4179-9926-c55db4c30f8e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:50:19.692246 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-df0e2c26-f7f4-4179-9926-c55db4c30f8e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:19.692706 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-df0e2c26-f7f4-4179-9926-c55db4c30f8e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:19.693519 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-df0e2c26-f7f4-4179-9926-c55db4c30f8e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:19.693972 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-df0e2c26-f7f4-4179-9926-c55db4c30f8e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:19.758492 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-df0e2c26-f7f4-4179-9926-c55db4c30f8e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a9f85caf65f431c96f27a7d04734211', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c438e59834c4084c818053e1fdb93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:50:19.766485 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-df0e2c26-f7f4-4179-9926-c55db4c30f8e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59" status: 200 len: 1225 microversion: 2.1 time: 0.090883 Jun 23 13:50:19.767054 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 540/1070] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:50:19 2022] GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:50:20.789500 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-ea5ef498-05ec-419f-8c26-daf996f7646e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:50:20.790652 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-ea5ef498-05ec-419f-8c26-daf996f7646e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:50:20.799211 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ea5ef498-05ec-419f-8c26-daf996f7646e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:20.799690 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ea5ef498-05ec-419f-8c26-daf996f7646e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:20.800445 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ea5ef498-05ec-419f-8c26-daf996f7646e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:20.800883 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-ea5ef498-05ec-419f-8c26-daf996f7646e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:20.814329 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.wsgi [None req-ea5ef498-05ec-419f-8c26-daf996f7646e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] HTTP exception thrown: Instance 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 could not be found. Jun 23 13:50:20.815967 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-ea5ef498-05ec-419f-8c26-daf996f7646e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Request method failure captured: Jun 23 13:50:20.815967 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: request: GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 HTTP/1.1 Jun 23 13:50:20.815967 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept: application/json Jun 23 13:50:20.815967 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept-Encoding: identity Jun 23 13:50:20.815967 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Connection: close Jun 23 13:50:20.815967 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Length: 0 Jun 23 13:50:20.815967 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Type: application/json Jun 23 13:50:20.815967 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Host: 10.222.0.26 Jun 23 13:50:20.815967 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Openstack-System-Scope: None Jun 23 13:50:20.815967 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: User-Agent: python-urllib3/1.26.9 Jun 23 13:50:20.815967 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Auth-Token: gAAAAABitG3LhHYxLw9V8q4SHO5dUJ0ZlE_I44zxSKkMSakbtRg_B1BDGNLxXvzE-VVy80jLCkdRC3l06S7zhBm8Oi4OkjoNGXcaRhMM6oj17IETDNl-rIvjYdOkoPRXCne87ZFxWkidUCT-AeZPw7Y2snKNRNW3KwjmToqlI8x2fMezG0FhYbg Jun 23 13:50:20.815967 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Id: None Jun 23 13:50:20.815967 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Name: None Jun 23 13:50:20.815967 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Identity-Status: Confirmed Jun 23 13:50:20.815967 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Is-Admin-Project: True Jun 23 13:50:20.815967 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Id: default Jun 23 13:50:20.815967 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Name: Default Jun 23 13:50:20.815967 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Id: 0d6c438e59834c4084c818053e1fdb93 Jun 23 13:50:20.815967 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Name: tempest-TestVolumeBootPattern-1088681018 Jun 23 13:50:20.815967 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Role: member,reader Jun 23 13:50:20.815967 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Roles: member,reader Jun 23 13:50:20.817549 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0d6c438e59834c4084c818053e1fdb93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0d6c438e59834c4084c818053e1fdb93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0d6c438e59834c4084c818053e1fdb93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0d6c438e59834c4084c818053e1fdb93", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:50:20.817549 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant: tempest-TestVolumeBootPattern-1088681018 Jun 23 13:50:20.817549 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Id: 0d6c438e59834c4084c818053e1fdb93 Jun 23 13:50:20.817549 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Name: tempest-TestVolumeBootPattern-1088681018 Jun 23 13:50:20.817549 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User: tempest-TestVolumeBootPattern-1088681018-project Jun 23 13:50:20.817549 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Id: default Jun 23 13:50:20.817549 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Name: Default Jun 23 13:50:20.817549 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Id: 0a9f85caf65f431c96f27a7d04734211 Jun 23 13:50:20.817549 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Name: tempest-TestVolumeBootPattern-1088681018-project Jun 23 13:50:20.817549 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: method: > Jun 23 13:50:20.817549 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: exception: Instance 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 could not be found. Jun 23 13:50:20.817549 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: action_args: {'id': '52cbfcd2-3b2d-44f2-a44d-55ab8868fd59'} Jun 23 13:50:20.818469 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:50:20.818469 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:50:20.818469 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:50:20.818469 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:50:20.818469 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:50:20.818469 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:50:20.818469 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:50:20.818469 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:50:20.818469 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:50:20.818469 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:50:20.818469 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 could not be found. Jun 23 13:50:20.818469 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:50:20.818469 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:50:20.818469 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:50:20.818469 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:50:20.818469 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:50:20.818469 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:50:20.818469 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:50:20.818469 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:50:20.818469 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:50:20.820087 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:50:20.820087 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:50:20.820087 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:50:20.820087 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:50:20.820087 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:50:20.820087 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:50:20.820087 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:50:20.820087 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 could not be found. Jun 23 13:50:20.820087 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:50:20.820087 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:50:20.820087 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:50:20.820087 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:50:20.820087 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:50:20.820087 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:50:20.820087 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:50:20.820087 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:50:20.820087 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 could not be found. Jun 23 13:50:20.820087 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:50:20.821481 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-ea5ef498-05ec-419f-8c26-daf996f7646e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Returning 404 to user: Instance 52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 could not be found. {{(pid=134666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:50:20.821481 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-ea5ef498-05ec-419f-8c26-daf996f7646e tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59" status: 404 len: 111 microversion: 2.1 time: 0.035721 Jun 23 13:50:20.821481 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 531/1071] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:50:20 2022] GET /compute/v2.1/servers/52cbfcd2-3b2d-44f2-a44d-55ab8868fd59 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:50:21.275803 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-4003d6b8-f7e9-4583-b145-a879a3a26a30 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:50:21.276353 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-4003d6b8-f7e9-4583-b145-a879a3a26a30 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:50:21.283597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4003d6b8-f7e9-4583-b145-a879a3a26a30 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:21.284042 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4003d6b8-f7e9-4583-b145-a879a3a26a30 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:21.284799 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4003d6b8-f7e9-4583-b145-a879a3a26a30 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:21.285250 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-4003d6b8-f7e9-4583-b145-a879a3a26a30 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:21.299736 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.wsgi [None req-4003d6b8-f7e9-4583-b145-a879a3a26a30 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] HTTP exception thrown: Instance 42c29e33-917a-4263-a80c-9863ed228875 could not be found. Jun 23 13:50:21.301369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-4003d6b8-f7e9-4583-b145-a879a3a26a30 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Request method failure captured: Jun 23 13:50:21.301369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: DELETE /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 HTTP/1.1 Jun 23 13:50:21.301369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:50:21.301369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:50:21.301369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:50:21.301369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 0 Jun 23 13:50:21.301369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:50:21.301369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:50:21.301369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:50:21.301369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:50:21.301369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitG3LhHYxLw9V8q4SHO5dUJ0ZlE_I44zxSKkMSakbtRg_B1BDGNLxXvzE-VVy80jLCkdRC3l06S7zhBm8Oi4OkjoNGXcaRhMM6oj17IETDNl-rIvjYdOkoPRXCne87ZFxWkidUCT-AeZPw7Y2snKNRNW3KwjmToqlI8x2fMezG0FhYbg Jun 23 13:50:21.301369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:50:21.301369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:50:21.301369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:50:21.301369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:50:21.301369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:50:21.301369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:50:21.301369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: 0d6c438e59834c4084c818053e1fdb93 Jun 23 13:50:21.301369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-TestVolumeBootPattern-1088681018 Jun 23 13:50:21.301369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:50:21.301369 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:50:21.302892 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0d6c438e59834c4084c818053e1fdb93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0d6c438e59834c4084c818053e1fdb93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0d6c438e59834c4084c818053e1fdb93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0d6c438e59834c4084c818053e1fdb93", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:50:21.302892 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-TestVolumeBootPattern-1088681018 Jun 23 13:50:21.302892 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: 0d6c438e59834c4084c818053e1fdb93 Jun 23 13:50:21.302892 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-TestVolumeBootPattern-1088681018 Jun 23 13:50:21.302892 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-TestVolumeBootPattern-1088681018-project Jun 23 13:50:21.302892 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:50:21.302892 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:50:21.302892 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: 0a9f85caf65f431c96f27a7d04734211 Jun 23 13:50:21.302892 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-TestVolumeBootPattern-1088681018-project Jun 23 13:50:21.302892 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: > Jun 23 13:50:21.302892 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Instance 42c29e33-917a-4263-a80c-9863ed228875 could not be found. Jun 23 13:50:21.302892 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'id': '42c29e33-917a-4263-a80c-9863ed228875'} Jun 23 13:50:21.303912 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:50:21.303912 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:50:21.303912 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:50:21.303912 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:50:21.303912 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:50:21.303912 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:50:21.303912 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:50:21.303912 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:50:21.303912 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:50:21.303912 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:50:21.303912 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42c29e33-917a-4263-a80c-9863ed228875 could not be found. Jun 23 13:50:21.303912 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:50:21.303912 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:50:21.303912 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:50:21.303912 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:50:21.303912 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:50:21.303912 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:50:21.303912 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:50:21.303912 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:50:21.303912 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:50:21.305400 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:50:21.305400 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 13:50:21.305400 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 13:50:21.305400 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 13:50:21.305400 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 13:50:21.305400 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:50:21.305400 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:50:21.305400 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:50:21.305400 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:50:21.305400 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42c29e33-917a-4263-a80c-9863ed228875 could not be found. Jun 23 13:50:21.305400 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:50:21.305400 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:50:21.305400 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:50:21.305400 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:50:21.305400 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:50:21.305400 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:50:21.305400 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:50:21.305400 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:50:21.305400 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42c29e33-917a-4263-a80c-9863ed228875 could not be found. Jun 23 13:50:21.305400 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:50:21.306895 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-4003d6b8-f7e9-4583-b145-a879a3a26a30 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Returning 404 to user: Instance 42c29e33-917a-4263-a80c-9863ed228875 could not be found. {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:50:21.306895 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-4003d6b8-f7e9-4583-b145-a879a3a26a30 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "DELETE /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 404 len: 111 microversion: 2.1 time: 0.030903 Jun 23 13:50:21.306895 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 541/1072] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Jun 23 13:50:21 2022] DELETE /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:50:21.311329 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-e5bf7327-caa7-45a7-9223-a9f4ba6e7786 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:50:21.312049 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-e5bf7327-caa7-45a7-9223-a9f4ba6e7786 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] [instance: 42c29e33-917a-4263-a80c-9863ed228875] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:50:21.318055 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e5bf7327-caa7-45a7-9223-a9f4ba6e7786 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:21.318499 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e5bf7327-caa7-45a7-9223-a9f4ba6e7786 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:21.319254 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e5bf7327-caa7-45a7-9223-a9f4ba6e7786 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:21.319710 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-e5bf7327-caa7-45a7-9223-a9f4ba6e7786 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:21.335209 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.wsgi [None req-e5bf7327-caa7-45a7-9223-a9f4ba6e7786 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] HTTP exception thrown: Instance 42c29e33-917a-4263-a80c-9863ed228875 could not be found. Jun 23 13:50:21.336761 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-e5bf7327-caa7-45a7-9223-a9f4ba6e7786 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Request method failure captured: Jun 23 13:50:21.336761 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: request: GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 HTTP/1.1 Jun 23 13:50:21.336761 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept: application/json Jun 23 13:50:21.336761 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept-Encoding: identity Jun 23 13:50:21.336761 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Connection: close Jun 23 13:50:21.336761 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Length: 0 Jun 23 13:50:21.336761 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Type: application/json Jun 23 13:50:21.336761 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Host: 10.222.0.26 Jun 23 13:50:21.336761 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Openstack-System-Scope: None Jun 23 13:50:21.336761 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: User-Agent: python-urllib3/1.26.9 Jun 23 13:50:21.336761 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Auth-Token: gAAAAABitG3LhHYxLw9V8q4SHO5dUJ0ZlE_I44zxSKkMSakbtRg_B1BDGNLxXvzE-VVy80jLCkdRC3l06S7zhBm8Oi4OkjoNGXcaRhMM6oj17IETDNl-rIvjYdOkoPRXCne87ZFxWkidUCT-AeZPw7Y2snKNRNW3KwjmToqlI8x2fMezG0FhYbg Jun 23 13:50:21.336761 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Id: None Jun 23 13:50:21.336761 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Name: None Jun 23 13:50:21.336761 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Identity-Status: Confirmed Jun 23 13:50:21.336761 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Is-Admin-Project: True Jun 23 13:50:21.336761 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Id: default Jun 23 13:50:21.336761 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Name: Default Jun 23 13:50:21.336761 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Id: 0d6c438e59834c4084c818053e1fdb93 Jun 23 13:50:21.336761 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Name: tempest-TestVolumeBootPattern-1088681018 Jun 23 13:50:21.336761 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Role: member,reader Jun 23 13:50:21.336761 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Roles: member,reader Jun 23 13:50:21.338324 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0d6c438e59834c4084c818053e1fdb93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0d6c438e59834c4084c818053e1fdb93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0d6c438e59834c4084c818053e1fdb93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0d6c438e59834c4084c818053e1fdb93", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:50:21.338324 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant: tempest-TestVolumeBootPattern-1088681018 Jun 23 13:50:21.338324 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Id: 0d6c438e59834c4084c818053e1fdb93 Jun 23 13:50:21.338324 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Name: tempest-TestVolumeBootPattern-1088681018 Jun 23 13:50:21.338324 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User: tempest-TestVolumeBootPattern-1088681018-project Jun 23 13:50:21.338324 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Id: default Jun 23 13:50:21.338324 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Name: Default Jun 23 13:50:21.338324 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Id: 0a9f85caf65f431c96f27a7d04734211 Jun 23 13:50:21.338324 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Name: tempest-TestVolumeBootPattern-1088681018-project Jun 23 13:50:21.338324 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: method: > Jun 23 13:50:21.338324 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: exception: Instance 42c29e33-917a-4263-a80c-9863ed228875 could not be found. Jun 23 13:50:21.338324 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: action_args: {'id': '42c29e33-917a-4263-a80c-9863ed228875'} Jun 23 13:50:21.339222 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:50:21.339222 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:50:21.339222 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:50:21.339222 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:50:21.339222 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:50:21.339222 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:50:21.339222 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:50:21.339222 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:50:21.339222 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:50:21.339222 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:50:21.339222 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42c29e33-917a-4263-a80c-9863ed228875 could not be found. Jun 23 13:50:21.339222 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:50:21.339222 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:50:21.339222 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:50:21.339222 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:50:21.339222 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:50:21.339222 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:50:21.339222 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:50:21.339222 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:50:21.339222 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:50:21.340735 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:50:21.340735 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:50:21.340735 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:50:21.340735 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:50:21.340735 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:50:21.340735 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:50:21.340735 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:50:21.340735 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42c29e33-917a-4263-a80c-9863ed228875 could not be found. Jun 23 13:50:21.340735 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:50:21.340735 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:50:21.340735 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:50:21.340735 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:50:21.340735 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:50:21.340735 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:50:21.340735 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:50:21.340735 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:50:21.340735 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42c29e33-917a-4263-a80c-9863ed228875 could not be found. Jun 23 13:50:21.340735 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:50:21.342257 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-e5bf7327-caa7-45a7-9223-a9f4ba6e7786 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Returning 404 to user: Instance 42c29e33-917a-4263-a80c-9863ed228875 could not be found. {{(pid=134666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:50:21.342257 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-e5bf7327-caa7-45a7-9223-a9f4ba6e7786 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875" status: 404 len: 111 microversion: 2.1 time: 0.030651 Jun 23 13:50:21.342257 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 532/1073] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:50:21 2022] GET /compute/v2.1/servers/42c29e33-917a-4263-a80c-9863ed228875 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:50:22.649961 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-42671f96-f171-40f5-9343-a31f511b72e7 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] Calling method '.version_select at 0x7fd77245c160>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:50:22.669755 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-42671f96-f171-40f5-9343-a31f511b72e7 tempest-TestVolumeBootPattern-1088681018 tempest-TestVolumeBootPattern-1088681018-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1938430720" status: 202 len: 0 microversion: 2.1 time: 0.024435 Jun 23 13:50:22.670582 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 542/1074] 10.222.0.26 () {58 vars in 1262 bytes} [Thu Jun 23 13:50:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1938430720 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 13:50:49.987861 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-a2e93333-4f32-40c6-abc6-7d950f1d1b69 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:50:49.988524 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-a2e93333-4f32-40c6-abc6-7d950f1d1b69 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:50:49.991187 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:49.991965 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG dbcounter [-] [134666] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=134666) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:50.001021 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a2e93333-4f32-40c6-abc6-7d950f1d1b69 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:50.001590 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a2e93333-4f32-40c6-abc6-7d950f1d1b69 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:50.002781 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a2e93333-4f32-40c6-abc6-7d950f1d1b69 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:50.003518 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-a2e93333-4f32-40c6-abc6-7d950f1d1b69 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:50.033239 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-a2e93333-4f32-40c6-abc6-7d950f1d1b69 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641/ips" status: 200 len: 146 microversion: 2.1 time: 0.050114 Jun 23 13:50:50.033794 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 533/1075] 10.222.0.26 () {58 vars in 1247 bytes} [Thu Jun 23 13:50:49 2022] GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641/ips => generated 146 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:50:51.359938 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_cell1:SELECT=14 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:51.360732 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG dbcounter [-] [134667] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=134667) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:50:51.365564 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-14b8cf7e-a666-4417-914b-9b68ef47f834 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1187ffc-dfe0-437a-b334-cf56a107a41f"}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:50:51.366550 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-14b8cf7e-a666-4417-914b-9b68ef47f834 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:50:51.374698 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-14b8cf7e-a666-4417-914b-9b68ef47f834 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:51.375173 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-14b8cf7e-a666-4417-914b-9b68ef47f834 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:51.375953 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-14b8cf7e-a666-4417-914b-9b68ef47f834 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:51.376382 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-14b8cf7e-a666-4417-914b-9b68ef47f834 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:51.625364 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-14b8cf7e-a666-4417-914b-9b68ef47f834 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "POST /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266722 Jun 23 13:50:51.625862 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 543/1076] 10.222.0.26 () {60 vars in 1322 bytes} [Thu Jun 23 13:50:51 2022] POST /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:50:58.124549 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-0543171d-365a-41a1-8162-a5036bcf4319 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:50:58.125508 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-0543171d-365a-41a1-8162-a5036bcf4319 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:50:58.132844 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0543171d-365a-41a1-8162-a5036bcf4319 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:58.133288 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0543171d-365a-41a1-8162-a5036bcf4319 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:58.134038 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0543171d-365a-41a1-8162-a5036bcf4319 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:58.134468 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-0543171d-365a-41a1-8162-a5036bcf4319 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:58.163172 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-0543171d-365a-41a1-8162-a5036bcf4319 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042690 Jun 23 13:50:58.163738 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 534/1077] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Jun 23 13:50:58 2022] GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:50:58.174849 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-71c83457-23c4-4fc1-900c-b48365be4268 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:50:58.175475 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-71c83457-23c4-4fc1-900c-b48365be4268 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:50:58.182103 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-71c83457-23c4-4fc1-900c-b48365be4268 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:58.182566 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-71c83457-23c4-4fc1-900c-b48365be4268 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:58.183352 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-71c83457-23c4-4fc1-900c-b48365be4268 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:58.183815 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-71c83457-23c4-4fc1-900c-b48365be4268 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:58.212258 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-71c83457-23c4-4fc1-900c-b48365be4268 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641/os-volume_attachments/a1187ffc-dfe0-437a-b334-cf56a107a41f" status: 200 len: 194 microversion: 2.1 time: 0.042364 Jun 23 13:50:58.212828 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 544/1078] 10.222.0.26 () {58 vars in 1412 bytes} [Thu Jun 23 13:50:58 2022] GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641/os-volume_attachments/a1187ffc-dfe0-437a-b334-cf56a107a41f => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:50:59.553197 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-afb74204-3cd0-4634-9d39-53b13e8b79af tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4272802d-f9cb-4bc7-be25-97ced62f0370"}} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:50:59.554326 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-afb74204-3cd0-4634-9d39-53b13e8b79af tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:50:59.561136 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-afb74204-3cd0-4634-9d39-53b13e8b79af tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:59.561592 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-afb74204-3cd0-4634-9d39-53b13e8b79af tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:59.562404 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-afb74204-3cd0-4634-9d39-53b13e8b79af tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:50:59.562842 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-afb74204-3cd0-4634-9d39-53b13e8b79af tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:50:59.805668 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-afb74204-3cd0-4634-9d39-53b13e8b79af tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "POST /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256371 Jun 23 13:50:59.806271 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 535/1079] 10.222.0.26 () {60 vars in 1322 bytes} [Thu Jun 23 13:50:59 2022] POST /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:51:06.292313 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-6aae9360-c455-4832-8b79-132404c8aef5 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:51:06.293302 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-6aae9360-c455-4832-8b79-132404c8aef5 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:51:06.300007 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6aae9360-c455-4832-8b79-132404c8aef5 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:06.300453 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6aae9360-c455-4832-8b79-132404c8aef5 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:06.301203 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6aae9360-c455-4832-8b79-132404c8aef5 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:06.301635 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6aae9360-c455-4832-8b79-132404c8aef5 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:06.331874 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-6aae9360-c455-4832-8b79-132404c8aef5 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043078 Jun 23 13:51:06.332352 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 545/1080] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Jun 23 13:51:06 2022] GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:51:06.483630 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-c391dd48-b1b9-43cd-af1b-a1e1bdb61217 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:51:06.484482 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-c391dd48-b1b9-43cd-af1b-a1e1bdb61217 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:51:06.491190 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c391dd48-b1b9-43cd-af1b-a1e1bdb61217 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:06.491667 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c391dd48-b1b9-43cd-af1b-a1e1bdb61217 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:06.492430 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c391dd48-b1b9-43cd-af1b-a1e1bdb61217 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:06.492866 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-c391dd48-b1b9-43cd-af1b-a1e1bdb61217 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:06.521719 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-c391dd48-b1b9-43cd-af1b-a1e1bdb61217 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641/os-volume_attachments/a1187ffc-dfe0-437a-b334-cf56a107a41f" status: 200 len: 194 microversion: 2.1 time: 0.046462 Jun 23 13:51:06.522464 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 536/1081] 10.222.0.26 () {58 vars in 1412 bytes} [Thu Jun 23 13:51:06 2022] GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641/os-volume_attachments/a1187ffc-dfe0-437a-b334-cf56a107a41f => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:51:06.534357 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-721c2e2e-06fd-445a-9de9-7e8d068f0621 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:51:06.534854 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-721c2e2e-06fd-445a-9de9-7e8d068f0621 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:51:06.541027 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-721c2e2e-06fd-445a-9de9-7e8d068f0621 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:06.541478 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-721c2e2e-06fd-445a-9de9-7e8d068f0621 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:06.542235 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-721c2e2e-06fd-445a-9de9-7e8d068f0621 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:06.542669 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-721c2e2e-06fd-445a-9de9-7e8d068f0621 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:06.626929 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.objects.instance [None req-721c2e2e-06fd-445a-9de9-7e8d068f0621 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lazy-loading 'services' on Instance uuid 3773db2f-4a1a-4a07-bb0f-f30771aac641 {{(pid=134667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:51:06.704778 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-721c2e2e-06fd-445a-9de9-7e8d068f0621 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641/os-volume_attachments/a1187ffc-dfe0-437a-b334-cf56a107a41f" status: 202 len: 0 microversion: 2.1 time: 0.174140 Jun 23 13:51:06.705466 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 546/1082] 10.222.0.26 () {58 vars in 1415 bytes} [Thu Jun 23 13:51:06 2022] DELETE /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641/os-volume_attachments/a1187ffc-dfe0-437a-b334-cf56a107a41f => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 13:51:07.824007 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-384ac67b-5538-496d-b28a-3e3254f918a8 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:51:07.824532 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-384ac67b-5538-496d-b28a-3e3254f918a8 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:51:07.831839 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-384ac67b-5538-496d-b28a-3e3254f918a8 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:07.832302 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-384ac67b-5538-496d-b28a-3e3254f918a8 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:07.833089 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-384ac67b-5538-496d-b28a-3e3254f918a8 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:07.833516 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-384ac67b-5538-496d-b28a-3e3254f918a8 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:07.861462 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-384ac67b-5538-496d-b28a-3e3254f918a8 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641/os-volume_attachments/4272802d-f9cb-4bc7-be25-97ced62f0370" status: 200 len: 194 microversion: 2.1 time: 0.041488 Jun 23 13:51:07.862021 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 537/1083] 10.222.0.26 () {58 vars in 1412 bytes} [Thu Jun 23 13:51:07 2022] GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641/os-volume_attachments/4272802d-f9cb-4bc7-be25-97ced62f0370 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:51:07.875044 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-77ddf291-0cac-4565-9f18-c7cd8a5e3480 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:51:07.875654 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-77ddf291-0cac-4565-9f18-c7cd8a5e3480 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:51:07.883613 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-77ddf291-0cac-4565-9f18-c7cd8a5e3480 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:07.884059 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-77ddf291-0cac-4565-9f18-c7cd8a5e3480 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:07.884819 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-77ddf291-0cac-4565-9f18-c7cd8a5e3480 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:07.885248 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-77ddf291-0cac-4565-9f18-c7cd8a5e3480 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:07.973197 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.objects.instance [None req-77ddf291-0cac-4565-9f18-c7cd8a5e3480 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lazy-loading 'services' on Instance uuid 3773db2f-4a1a-4a07-bb0f-f30771aac641 {{(pid=134667) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 13:51:08.056809 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-77ddf291-0cac-4565-9f18-c7cd8a5e3480 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641/os-volume_attachments/4272802d-f9cb-4bc7-be25-97ced62f0370" status: 202 len: 0 microversion: 2.1 time: 0.186327 Jun 23 13:51:08.057394 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 547/1084] 10.222.0.26 () {58 vars in 1415 bytes} [Thu Jun 23 13:51:07 2022] DELETE /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641/os-volume_attachments/4272802d-f9cb-4bc7-be25-97ced62f0370 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 13:51:09.232775 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-d7d64ecc-0bcf-46a7-a441-8264f93f0e94 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:51:09.234353 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-d7d64ecc-0bcf-46a7-a441-8264f93f0e94 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:51:09.245018 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d7d64ecc-0bcf-46a7-a441-8264f93f0e94 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:09.245591 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d7d64ecc-0bcf-46a7-a441-8264f93f0e94 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:09.246667 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d7d64ecc-0bcf-46a7-a441-8264f93f0e94 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:09.247374 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-d7d64ecc-0bcf-46a7-a441-8264f93f0e94 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:09.277310 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-d7d64ecc-0bcf-46a7-a441-8264f93f0e94 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050859 Jun 23 13:51:09.277860 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 538/1085] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Jun 23 13:51:09 2022] GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 13:51:09.392579 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-92bb320c-c4ee-423f-97fb-326e23499d95 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:51:09.393635 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-92bb320c-c4ee-423f-97fb-326e23499d95 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:51:09.400834 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-92bb320c-c4ee-423f-97fb-326e23499d95 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:09.401289 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-92bb320c-c4ee-423f-97fb-326e23499d95 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:09.402067 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-92bb320c-c4ee-423f-97fb-326e23499d95 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:09.402509 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-92bb320c-c4ee-423f-97fb-326e23499d95 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:09.432392 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-92bb320c-c4ee-423f-97fb-326e23499d95 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044265 Jun 23 13:51:09.433115 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 548/1086] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Jun 23 13:51:09 2022] GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 13:51:09.493171 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-660d5ecd-2a6a-45c2-ae07-317dddb6d746 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:51:09.493656 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-660d5ecd-2a6a-45c2-ae07-317dddb6d746 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:51:09.500080 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-660d5ecd-2a6a-45c2-ae07-317dddb6d746 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:09.500527 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-660d5ecd-2a6a-45c2-ae07-317dddb6d746 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:09.501280 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-660d5ecd-2a6a-45c2-ae07-317dddb6d746 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:09.501708 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-660d5ecd-2a6a-45c2-ae07-317dddb6d746 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:09.526378 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-660d5ecd-2a6a-45c2-ae07-317dddb6d746 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Going to try to terminate instance {{(pid=134666) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 13:51:09.618972 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-660d5ecd-2a6a-45c2-ae07-317dddb6d746 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641" status: 204 len: 0 microversion: 2.1 time: 0.129241 Jun 23 13:51:09.619768 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 539/1087] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Jun 23 13:51:09 2022] DELETE /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 13:51:09.628451 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-6c39fd9a-bd75-4473-9ca6-8db7fb7ea24d tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:51:09.629069 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-6c39fd9a-bd75-4473-9ca6-8db7fb7ea24d tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:51:09.635070 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6c39fd9a-bd75-4473-9ca6-8db7fb7ea24d tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:09.635576 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6c39fd9a-bd75-4473-9ca6-8db7fb7ea24d tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:09.636339 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6c39fd9a-bd75-4473-9ca6-8db7fb7ea24d tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:09.636778 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-6c39fd9a-bd75-4473-9ca6-8db7fb7ea24d tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:09.776702 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-6c39fd9a-bd75-4473-9ca6-8db7fb7ea24d tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:51:09.784599 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-6c39fd9a-bd75-4473-9ca6-8db7fb7ea24d tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641" status: 200 len: 1672 microversion: 2.1 time: 0.160380 Jun 23 13:51:09.785174 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 549/1088] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:51:09 2022] GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:51:10.808032 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-3b5fd8b1-7cbf-49b4-896a-e9efc22c622a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:51:10.809185 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-3b5fd8b1-7cbf-49b4-896a-e9efc22c622a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:51:10.817225 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3b5fd8b1-7cbf-49b4-896a-e9efc22c622a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:10.817670 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3b5fd8b1-7cbf-49b4-896a-e9efc22c622a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:10.818423 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3b5fd8b1-7cbf-49b4-896a-e9efc22c622a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:10.818863 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-3b5fd8b1-7cbf-49b4-896a-e9efc22c622a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:10.957229 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.policy [None req-3b5fd8b1-7cbf-49b4-896a-e9efc22c622a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134666) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:51:10.969054 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-3b5fd8b1-7cbf-49b4-896a-e9efc22c622a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641" status: 200 len: 1672 microversion: 2.1 time: 0.168901 Jun 23 13:51:10.969910 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 540/1089] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:51:10 2022] GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641 => generated 1672 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:51:11.986296 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-9a5fc9e4-4ab3-486d-8aa2-92d674b49559 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:51:11.987022 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-9a5fc9e4-4ab3-486d-8aa2-92d674b49559 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:51:11.994077 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9a5fc9e4-4ab3-486d-8aa2-92d674b49559 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:11.994534 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9a5fc9e4-4ab3-486d-8aa2-92d674b49559 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:11.995293 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9a5fc9e4-4ab3-486d-8aa2-92d674b49559 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:11.995782 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-9a5fc9e4-4ab3-486d-8aa2-92d674b49559 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:12.060237 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.policy [None req-9a5fc9e4-4ab3-486d-8aa2-92d674b49559 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2754a81c57c249cfa1bc9f0eb08e4dac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d1fbb158dc4d63a7aeb04d115f7636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=134667) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 13:51:12.068462 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-9a5fc9e4-4ab3-486d-8aa2-92d674b49559 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641" status: 200 len: 1605 microversion: 2.1 time: 0.085980 Jun 23 13:51:12.069052 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 550/1090] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:51:11 2022] GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641 => generated 1605 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 13:51:12.387911 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [req-15acd558-bac6-4d7d-b0ec-6b7fbd3ca9b8 req-865982c3-0c1c-4104-8e7e-94bd6ed25420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3773db2f-4a1a-4a07-bb0f-f30771aac641", "name": "network-vif-deleted", "tag": "8ed184ed-283e-4add-9846-2ecc4c944c3e"}]} {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:51:12.397236 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-15acd558-bac6-4d7d-b0ec-6b7fbd3ca9b8 req-865982c3-0c1c-4104-8e7e-94bd6ed25420 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:12.397803 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [req-15acd558-bac6-4d7d-b0ec-6b7fbd3ca9b8 req-865982c3-0c1c-4104-8e7e-94bd6ed25420 service nova] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:12.410728 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.compute.server_external_events [req-15acd558-bac6-4d7d-b0ec-6b7fbd3ca9b8 req-865982c3-0c1c-4104-8e7e-94bd6ed25420 service nova] Creating event network-vif-deleted:8ed184ed-283e-4add-9846-2ecc4c944c3e for instance 3773db2f-4a1a-4a07-bb0f-f30771aac641 on hv-cinder-81558 Jun 23 13:51:12.416124 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [req-15acd558-bac6-4d7d-b0ec-6b7fbd3ca9b8 req-865982c3-0c1c-4104-8e7e-94bd6ed25420 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031953 Jun 23 13:51:12.416854 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 541/1091] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Jun 23 13:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:51:13.085431 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-b25ac0be-f75b-47e4-92a4-14a96f016d23 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:51:13.086020 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-b25ac0be-f75b-47e4-92a4-14a96f016d23 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:51:13.093013 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b25ac0be-f75b-47e4-92a4-14a96f016d23 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:13.093547 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b25ac0be-f75b-47e4-92a4-14a96f016d23 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:13.094419 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b25ac0be-f75b-47e4-92a4-14a96f016d23 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:13.094929 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-b25ac0be-f75b-47e4-92a4-14a96f016d23 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:13.108803 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.wsgi [None req-b25ac0be-f75b-47e4-92a4-14a96f016d23 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] HTTP exception thrown: Instance 3773db2f-4a1a-4a07-bb0f-f30771aac641 could not be found. Jun 23 13:51:13.110597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-b25ac0be-f75b-47e4-92a4-14a96f016d23 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Request method failure captured: Jun 23 13:51:13.110597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641 HTTP/1.1 Jun 23 13:51:13.110597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:51:13.110597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:51:13.110597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:51:13.110597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 0 Jun 23 13:51:13.110597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:51:13.110597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:51:13.110597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:51:13.110597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:51:13.110597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitG7UurDz-KPsa8stkrVU0vZYzsnANg635YiLVe5U6Qbpk9FsYPz82vXWs-suucGK83rFNf_tPooVx7Ro49zZT4PCS3PHfs7ce1Bj2P0U96tXFPhBuJHhKhrnqhvzWVcHgbm1k0WlELAE8RF18zQuqmlIzGjgiu7j6Jup0GRX58bOZfs Jun 23 13:51:13.110597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:51:13.110597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:51:13.110597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:51:13.110597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:51:13.110597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:51:13.110597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:51:13.110597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: f9d1fbb158dc4d63a7aeb04d115f7636 Jun 23 13:51:13.110597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-AttachVolumeTestJSON-1773703291 Jun 23 13:51:13.110597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:51:13.110597 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:51:13.112082 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f9d1fbb158dc4d63a7aeb04d115f7636"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9d1fbb158dc4d63a7aeb04d115f7636"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9d1fbb158dc4d63a7aeb04d115f7636"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f9d1fbb158dc4d63a7aeb04d115f7636", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:51:13.112082 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-AttachVolumeTestJSON-1773703291 Jun 23 13:51:13.112082 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: f9d1fbb158dc4d63a7aeb04d115f7636 Jun 23 13:51:13.112082 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1773703291 Jun 23 13:51:13.112082 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-AttachVolumeTestJSON-1773703291-project Jun 23 13:51:13.112082 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:51:13.112082 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:51:13.112082 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: 2754a81c57c249cfa1bc9f0eb08e4dac Jun 23 13:51:13.112082 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-AttachVolumeTestJSON-1773703291-project Jun 23 13:51:13.112082 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: > Jun 23 13:51:13.112082 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Instance 3773db2f-4a1a-4a07-bb0f-f30771aac641 could not be found. Jun 23 13:51:13.112082 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'id': '3773db2f-4a1a-4a07-bb0f-f30771aac641'} Jun 23 13:51:13.112934 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:51:13.112934 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:51:13.112934 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:51:13.112934 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:51:13.112934 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:51:13.112934 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:51:13.112934 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:51:13.112934 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:51:13.112934 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:51:13.112934 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:51:13.112934 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3773db2f-4a1a-4a07-bb0f-f30771aac641 could not be found. Jun 23 13:51:13.112934 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:51:13.112934 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:51:13.112934 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:51:13.112934 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:51:13.112934 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:51:13.112934 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:51:13.112934 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:51:13.112934 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:51:13.112934 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:51:13.114700 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:51:13.114700 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:51:13.114700 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:51:13.114700 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:51:13.114700 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:51:13.114700 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:51:13.114700 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:51:13.114700 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3773db2f-4a1a-4a07-bb0f-f30771aac641 could not be found. Jun 23 13:51:13.114700 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:51:13.114700 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:51:13.114700 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:51:13.114700 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:51:13.114700 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:51:13.114700 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:51:13.114700 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:51:13.114700 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:51:13.114700 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3773db2f-4a1a-4a07-bb0f-f30771aac641 could not be found. Jun 23 13:51:13.114700 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:51:13.116260 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-b25ac0be-f75b-47e4-92a4-14a96f016d23 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Returning 404 to user: Instance 3773db2f-4a1a-4a07-bb0f-f30771aac641 could not be found. {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:51:13.116260 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-b25ac0be-f75b-47e4-92a4-14a96f016d23 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641" status: 404 len: 111 microversion: 2.1 time: 0.030919 Jun 23 13:51:13.116260 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 551/1092] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:51:13 2022] GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:51:13.122086 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-8a167b66-e0d1-4155-9e4e-b03f90d99f45 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '.version_select at 0x7fd7727ce790>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:51:13.142784 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-8a167b66-e0d1-4155-9e4e-b03f90d99f45 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-571269994" status: 202 len: 0 microversion: 2.1 time: 0.024815 Jun 23 13:51:13.143385 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 542/1093] 10.222.0.26 () {58 vars in 1217 bytes} [Thu Jun 23 13:51:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-571269994 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 13:51:13.830916 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 13:51:13.831110 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Thu Jun 23 13:51:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 13:51:16.078239 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-bdf08bda-00dc-42f7-8069-5d24a76bac34 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:51:16.078837 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-bdf08bda-00dc-42f7-8069-5d24a76bac34 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:51:16.086028 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bdf08bda-00dc-42f7-8069-5d24a76bac34 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:16.086487 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bdf08bda-00dc-42f7-8069-5d24a76bac34 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:16.087262 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bdf08bda-00dc-42f7-8069-5d24a76bac34 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:16.087803 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-bdf08bda-00dc-42f7-8069-5d24a76bac34 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:16.101817 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.wsgi [None req-bdf08bda-00dc-42f7-8069-5d24a76bac34 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] HTTP exception thrown: Instance 3773db2f-4a1a-4a07-bb0f-f30771aac641 could not be found. Jun 23 13:51:16.103468 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-bdf08bda-00dc-42f7-8069-5d24a76bac34 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Request method failure captured: Jun 23 13:51:16.103468 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: DELETE /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641 HTTP/1.1 Jun 23 13:51:16.103468 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:51:16.103468 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:51:16.103468 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:51:16.103468 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 0 Jun 23 13:51:16.103468 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:51:16.103468 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:51:16.103468 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:51:16.103468 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:51:16.103468 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitG7UurDz-KPsa8stkrVU0vZYzsnANg635YiLVe5U6Qbpk9FsYPz82vXWs-suucGK83rFNf_tPooVx7Ro49zZT4PCS3PHfs7ce1Bj2P0U96tXFPhBuJHhKhrnqhvzWVcHgbm1k0WlELAE8RF18zQuqmlIzGjgiu7j6Jup0GRX58bOZfs Jun 23 13:51:16.103468 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:51:16.103468 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:51:16.103468 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:51:16.103468 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:51:16.103468 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:51:16.103468 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:51:16.103468 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: f9d1fbb158dc4d63a7aeb04d115f7636 Jun 23 13:51:16.103468 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-AttachVolumeTestJSON-1773703291 Jun 23 13:51:16.103468 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:51:16.103468 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:51:16.105119 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f9d1fbb158dc4d63a7aeb04d115f7636"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9d1fbb158dc4d63a7aeb04d115f7636"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9d1fbb158dc4d63a7aeb04d115f7636"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f9d1fbb158dc4d63a7aeb04d115f7636", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:51:16.105119 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-AttachVolumeTestJSON-1773703291 Jun 23 13:51:16.105119 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: f9d1fbb158dc4d63a7aeb04d115f7636 Jun 23 13:51:16.105119 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1773703291 Jun 23 13:51:16.105119 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-AttachVolumeTestJSON-1773703291-project Jun 23 13:51:16.105119 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:51:16.105119 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:51:16.105119 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: 2754a81c57c249cfa1bc9f0eb08e4dac Jun 23 13:51:16.105119 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-AttachVolumeTestJSON-1773703291-project Jun 23 13:51:16.105119 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: > Jun 23 13:51:16.105119 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Instance 3773db2f-4a1a-4a07-bb0f-f30771aac641 could not be found. Jun 23 13:51:16.105119 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'id': '3773db2f-4a1a-4a07-bb0f-f30771aac641'} Jun 23 13:51:16.106049 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:51:16.106049 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:51:16.106049 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:51:16.106049 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:51:16.106049 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:51:16.106049 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:51:16.106049 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:51:16.106049 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:51:16.106049 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:51:16.106049 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:51:16.106049 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3773db2f-4a1a-4a07-bb0f-f30771aac641 could not be found. Jun 23 13:51:16.106049 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:51:16.106049 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:51:16.106049 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:51:16.106049 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:51:16.106049 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:51:16.106049 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:51:16.106049 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:51:16.106049 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:51:16.106049 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:51:16.111903 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:51:16.111903 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 13:51:16.111903 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 13:51:16.111903 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 13:51:16.111903 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 13:51:16.111903 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:51:16.111903 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:51:16.111903 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:51:16.111903 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:51:16.111903 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3773db2f-4a1a-4a07-bb0f-f30771aac641 could not be found. Jun 23 13:51:16.111903 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:51:16.111903 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:51:16.111903 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:51:16.111903 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:51:16.111903 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:51:16.111903 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:51:16.111903 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:51:16.111903 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:51:16.111903 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3773db2f-4a1a-4a07-bb0f-f30771aac641 could not be found. Jun 23 13:51:16.111903 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:51:16.113590 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-bdf08bda-00dc-42f7-8069-5d24a76bac34 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Returning 404 to user: Instance 3773db2f-4a1a-4a07-bb0f-f30771aac641 could not be found. {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:51:16.113590 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-bdf08bda-00dc-42f7-8069-5d24a76bac34 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641" status: 404 len: 111 microversion: 2.1 time: 0.030632 Jun 23 13:51:16.113590 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 552/1094] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Jun 23 13:51:16 2022] DELETE /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:51:16.114377 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-bbbfce8c-f30a-49f2-8a62-f44c745f68c5 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:51:16.114732 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-bbbfce8c-f30a-49f2-8a62-f44c745f68c5 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: 3773db2f-4a1a-4a07-bb0f-f30771aac641] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:51:16.121028 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-bbbfce8c-f30a-49f2-8a62-f44c745f68c5 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:16.121474 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-bbbfce8c-f30a-49f2-8a62-f44c745f68c5 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:16.122202 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-bbbfce8c-f30a-49f2-8a62-f44c745f68c5 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:16.122729 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-bbbfce8c-f30a-49f2-8a62-f44c745f68c5 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:16.136289 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.wsgi [None req-bbbfce8c-f30a-49f2-8a62-f44c745f68c5 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] HTTP exception thrown: Instance 3773db2f-4a1a-4a07-bb0f-f30771aac641 could not be found. Jun 23 13:51:16.137886 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-bbbfce8c-f30a-49f2-8a62-f44c745f68c5 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Request method failure captured: Jun 23 13:51:16.137886 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: request: GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641 HTTP/1.1 Jun 23 13:51:16.137886 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept: application/json Jun 23 13:51:16.137886 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept-Encoding: identity Jun 23 13:51:16.137886 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Connection: close Jun 23 13:51:16.137886 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Length: 0 Jun 23 13:51:16.137886 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Type: application/json Jun 23 13:51:16.137886 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Host: 10.222.0.26 Jun 23 13:51:16.137886 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Openstack-System-Scope: None Jun 23 13:51:16.137886 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: User-Agent: python-urllib3/1.26.9 Jun 23 13:51:16.137886 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Auth-Token: gAAAAABitG7UurDz-KPsa8stkrVU0vZYzsnANg635YiLVe5U6Qbpk9FsYPz82vXWs-suucGK83rFNf_tPooVx7Ro49zZT4PCS3PHfs7ce1Bj2P0U96tXFPhBuJHhKhrnqhvzWVcHgbm1k0WlELAE8RF18zQuqmlIzGjgiu7j6Jup0GRX58bOZfs Jun 23 13:51:16.137886 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Id: None Jun 23 13:51:16.137886 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Name: None Jun 23 13:51:16.137886 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Identity-Status: Confirmed Jun 23 13:51:16.137886 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Is-Admin-Project: True Jun 23 13:51:16.137886 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Id: default Jun 23 13:51:16.137886 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Name: Default Jun 23 13:51:16.137886 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Id: f9d1fbb158dc4d63a7aeb04d115f7636 Jun 23 13:51:16.137886 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Name: tempest-AttachVolumeTestJSON-1773703291 Jun 23 13:51:16.137886 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Role: member,reader Jun 23 13:51:16.137886 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Roles: member,reader Jun 23 13:51:16.139492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f9d1fbb158dc4d63a7aeb04d115f7636"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9d1fbb158dc4d63a7aeb04d115f7636"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9d1fbb158dc4d63a7aeb04d115f7636"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f9d1fbb158dc4d63a7aeb04d115f7636", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:51:16.139492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant: tempest-AttachVolumeTestJSON-1773703291 Jun 23 13:51:16.139492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Id: f9d1fbb158dc4d63a7aeb04d115f7636 Jun 23 13:51:16.139492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1773703291 Jun 23 13:51:16.139492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User: tempest-AttachVolumeTestJSON-1773703291-project Jun 23 13:51:16.139492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Id: default Jun 23 13:51:16.139492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Name: Default Jun 23 13:51:16.139492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Id: 2754a81c57c249cfa1bc9f0eb08e4dac Jun 23 13:51:16.139492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Name: tempest-AttachVolumeTestJSON-1773703291-project Jun 23 13:51:16.139492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: method: > Jun 23 13:51:16.139492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: exception: Instance 3773db2f-4a1a-4a07-bb0f-f30771aac641 could not be found. Jun 23 13:51:16.139492 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: action_args: {'id': '3773db2f-4a1a-4a07-bb0f-f30771aac641'} Jun 23 13:51:16.140491 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:51:16.140491 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:51:16.140491 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:51:16.140491 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:51:16.140491 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:51:16.140491 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:51:16.140491 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:51:16.140491 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:51:16.140491 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:51:16.140491 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:51:16.140491 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3773db2f-4a1a-4a07-bb0f-f30771aac641 could not be found. Jun 23 13:51:16.140491 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:51:16.140491 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:51:16.140491 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:51:16.140491 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:51:16.140491 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:51:16.140491 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:51:16.140491 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:51:16.140491 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:51:16.140491 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:51:16.141878 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:51:16.141878 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:51:16.141878 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:51:16.141878 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:51:16.141878 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:51:16.141878 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:51:16.141878 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:51:16.141878 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3773db2f-4a1a-4a07-bb0f-f30771aac641 could not be found. Jun 23 13:51:16.141878 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:51:16.141878 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:51:16.141878 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:51:16.141878 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:51:16.141878 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:51:16.141878 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:51:16.141878 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:51:16.141878 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:51:16.141878 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3773db2f-4a1a-4a07-bb0f-f30771aac641 could not be found. Jun 23 13:51:16.141878 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:51:16.143490 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-bbbfce8c-f30a-49f2-8a62-f44c745f68c5 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Returning 404 to user: Instance 3773db2f-4a1a-4a07-bb0f-f30771aac641 could not be found. {{(pid=134666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:51:16.143490 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-bbbfce8c-f30a-49f2-8a62-f44c745f68c5 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641" status: 404 len: 111 microversion: 2.1 time: 0.029731 Jun 23 13:51:16.143490 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 543/1095] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:51:16 2022] GET /compute/v2.1/servers/3773db2f-4a1a-4a07-bb0f-f30771aac641 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:51:17.293920 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-3f9ef28e-46ce-4a06-827b-5e526392ff72 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:51:17.294424 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.compute.api [None req-3f9ef28e-46ce-4a06-827b-5e526392ff72 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134667) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:51:17.304660 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3f9ef28e-46ce-4a06-827b-5e526392ff72 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:17.305177 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3f9ef28e-46ce-4a06-827b-5e526392ff72 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:17.306145 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3f9ef28e-46ce-4a06-827b-5e526392ff72 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:17.306780 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG oslo_concurrency.lockutils [None req-3f9ef28e-46ce-4a06-827b-5e526392ff72 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=134667) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:17.321948 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.wsgi [None req-3f9ef28e-46ce-4a06-827b-5e526392ff72 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] HTTP exception thrown: Instance a45e14a5-376a-40fb-8ea0-934aa3de116a could not be found. Jun 23 13:51:17.323563 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-3f9ef28e-46ce-4a06-827b-5e526392ff72 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Request method failure captured: Jun 23 13:51:17.323563 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: DELETE /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a HTTP/1.1 Jun 23 13:51:17.323563 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:51:17.323563 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:51:17.323563 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:51:17.323563 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 0 Jun 23 13:51:17.323563 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:51:17.323563 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:51:17.323563 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:51:17.323563 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:51:17.323563 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitG7UurDz-KPsa8stkrVU0vZYzsnANg635YiLVe5U6Qbpk9FsYPz82vXWs-suucGK83rFNf_tPooVx7Ro49zZT4PCS3PHfs7ce1Bj2P0U96tXFPhBuJHhKhrnqhvzWVcHgbm1k0WlELAE8RF18zQuqmlIzGjgiu7j6Jup0GRX58bOZfs Jun 23 13:51:17.323563 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:51:17.323563 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:51:17.323563 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:51:17.323563 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:51:17.323563 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:51:17.323563 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:51:17.323563 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: f9d1fbb158dc4d63a7aeb04d115f7636 Jun 23 13:51:17.323563 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-AttachVolumeTestJSON-1773703291 Jun 23 13:51:17.323563 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:51:17.323563 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:51:17.325033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f9d1fbb158dc4d63a7aeb04d115f7636"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9d1fbb158dc4d63a7aeb04d115f7636"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9d1fbb158dc4d63a7aeb04d115f7636"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f9d1fbb158dc4d63a7aeb04d115f7636", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:51:17.325033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-AttachVolumeTestJSON-1773703291 Jun 23 13:51:17.325033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: f9d1fbb158dc4d63a7aeb04d115f7636 Jun 23 13:51:17.325033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1773703291 Jun 23 13:51:17.325033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-AttachVolumeTestJSON-1773703291-project Jun 23 13:51:17.325033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:51:17.325033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:51:17.325033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: 2754a81c57c249cfa1bc9f0eb08e4dac Jun 23 13:51:17.325033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-AttachVolumeTestJSON-1773703291-project Jun 23 13:51:17.325033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: > Jun 23 13:51:17.325033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Instance a45e14a5-376a-40fb-8ea0-934aa3de116a could not be found. Jun 23 13:51:17.325033 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'id': 'a45e14a5-376a-40fb-8ea0-934aa3de116a'} Jun 23 13:51:17.325801 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:51:17.325801 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:51:17.325801 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:51:17.325801 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:51:17.325801 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:51:17.325801 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:51:17.325801 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:51:17.325801 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:51:17.325801 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:51:17.325801 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:51:17.325801 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a45e14a5-376a-40fb-8ea0-934aa3de116a could not be found. Jun 23 13:51:17.325801 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:51:17.325801 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:51:17.325801 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:51:17.325801 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:51:17.325801 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:51:17.325801 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:51:17.325801 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:51:17.325801 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:51:17.325801 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:51:17.327161 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:51:17.327161 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 13:51:17.327161 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 13:51:17.327161 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 13:51:17.327161 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 13:51:17.327161 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:51:17.327161 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:51:17.327161 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:51:17.327161 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:51:17.327161 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a45e14a5-376a-40fb-8ea0-934aa3de116a could not be found. Jun 23 13:51:17.327161 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:51:17.327161 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:51:17.327161 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:51:17.327161 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:51:17.327161 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:51:17.327161 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:51:17.327161 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:51:17.327161 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:51:17.327161 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a45e14a5-376a-40fb-8ea0-934aa3de116a could not be found. Jun 23 13:51:17.327161 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:51:17.328446 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-3f9ef28e-46ce-4a06-827b-5e526392ff72 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Returning 404 to user: Instance a45e14a5-376a-40fb-8ea0-934aa3de116a could not be found. {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:51:17.328446 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-3f9ef28e-46ce-4a06-827b-5e526392ff72 tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 404 len: 111 microversion: 2.1 time: 0.037339 Jun 23 13:51:17.328446 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 553/1096] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Jun 23 13:51:17 2022] DELETE /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:51:17.333884 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-9d467634-2659-4b98-b61d-0e1c1388206a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Calling method '>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:51:17.334530 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.compute.api [None req-9d467634-2659-4b98-b61d-0e1c1388206a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] [instance: a45e14a5-376a-40fb-8ea0-934aa3de116a] Fetching instance by UUID {{(pid=134666) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 13:51:17.341459 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9d467634-2659-4b98-b61d-0e1c1388206a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:17.341912 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9d467634-2659-4b98-b61d-0e1c1388206a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:17.342677 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9d467634-2659-4b98-b61d-0e1c1388206a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 13:51:17.343114 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG oslo_concurrency.lockutils [None req-9d467634-2659-4b98-b61d-0e1c1388206a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Lock "442bd7d1-8f5b-459f-a9f7-5a1a1641d3d0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=134666) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 13:51:17.356553 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.wsgi [None req-9d467634-2659-4b98-b61d-0e1c1388206a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] HTTP exception thrown: Instance a45e14a5-376a-40fb-8ea0-934aa3de116a could not be found. Jun 23 13:51:17.358071 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-9d467634-2659-4b98-b61d-0e1c1388206a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Request method failure captured: Jun 23 13:51:17.358071 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: request: GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a HTTP/1.1 Jun 23 13:51:17.358071 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept: application/json Jun 23 13:51:17.358071 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Accept-Encoding: identity Jun 23 13:51:17.358071 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Connection: close Jun 23 13:51:17.358071 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Length: 0 Jun 23 13:51:17.358071 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Content-Type: application/json Jun 23 13:51:17.358071 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Host: 10.222.0.26 Jun 23 13:51:17.358071 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Openstack-System-Scope: None Jun 23 13:51:17.358071 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: User-Agent: python-urllib3/1.26.9 Jun 23 13:51:17.358071 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Auth-Token: gAAAAABitG7UurDz-KPsa8stkrVU0vZYzsnANg635YiLVe5U6Qbpk9FsYPz82vXWs-suucGK83rFNf_tPooVx7Ro49zZT4PCS3PHfs7ce1Bj2P0U96tXFPhBuJHhKhrnqhvzWVcHgbm1k0WlELAE8RF18zQuqmlIzGjgiu7j6Jup0GRX58bOZfs Jun 23 13:51:17.358071 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Id: None Jun 23 13:51:17.358071 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Domain-Name: None Jun 23 13:51:17.358071 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Identity-Status: Confirmed Jun 23 13:51:17.358071 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Is-Admin-Project: True Jun 23 13:51:17.358071 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Id: default Jun 23 13:51:17.358071 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Domain-Name: Default Jun 23 13:51:17.358071 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Id: f9d1fbb158dc4d63a7aeb04d115f7636 Jun 23 13:51:17.358071 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Project-Name: tempest-AttachVolumeTestJSON-1773703291 Jun 23 13:51:17.358071 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Role: member,reader Jun 23 13:51:17.358071 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Roles: member,reader Jun 23 13:51:17.359721 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f9d1fbb158dc4d63a7aeb04d115f7636"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9d1fbb158dc4d63a7aeb04d115f7636"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9d1fbb158dc4d63a7aeb04d115f7636"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f9d1fbb158dc4d63a7aeb04d115f7636", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:51:17.359721 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant: tempest-AttachVolumeTestJSON-1773703291 Jun 23 13:51:17.359721 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Id: f9d1fbb158dc4d63a7aeb04d115f7636 Jun 23 13:51:17.359721 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1773703291 Jun 23 13:51:17.359721 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User: tempest-AttachVolumeTestJSON-1773703291-project Jun 23 13:51:17.359721 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Id: default Jun 23 13:51:17.359721 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Domain-Name: Default Jun 23 13:51:17.359721 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Id: 2754a81c57c249cfa1bc9f0eb08e4dac Jun 23 13:51:17.359721 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: X-User-Name: tempest-AttachVolumeTestJSON-1773703291-project Jun 23 13:51:17.359721 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: method: > Jun 23 13:51:17.359721 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: exception: Instance a45e14a5-376a-40fb-8ea0-934aa3de116a could not be found. Jun 23 13:51:17.359721 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: action_args: {'id': 'a45e14a5-376a-40fb-8ea0-934aa3de116a'} Jun 23 13:51:17.360687 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:51:17.360687 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:51:17.360687 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 13:51:17.360687 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 13:51:17.360687 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 13:51:17.360687 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 13:51:17.360687 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 13:51:17.360687 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 13:51:17.360687 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 13:51:17.360687 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 13:51:17.360687 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a45e14a5-376a-40fb-8ea0-934aa3de116a could not be found. Jun 23 13:51:17.360687 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:51:17.360687 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:51:17.360687 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:51:17.360687 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:51:17.360687 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:51:17.360687 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:51:17.360687 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:51:17.360687 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:51:17.360687 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:51:17.362241 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:51:17.362241 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 13:51:17.362241 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 13:51:17.362241 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 13:51:17.362241 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 13:51:17.362241 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 13:51:17.362241 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:51:17.362241 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a45e14a5-376a-40fb-8ea0-934aa3de116a could not be found. Jun 23 13:51:17.362241 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:51:17.362241 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:51:17.362241 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:51:17.362241 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:51:17.362241 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:51:17.362241 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:51:17.362241 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:51:17.362241 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:51:17.362241 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a45e14a5-376a-40fb-8ea0-934aa3de116a could not be found. Jun 23 13:51:17.362241 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: ERROR nova.api.openstack.wsgi Jun 23 13:51:17.363612 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-9d467634-2659-4b98-b61d-0e1c1388206a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] Returning 404 to user: Instance a45e14a5-376a-40fb-8ea0-934aa3de116a could not be found. {{(pid=134666) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:51:17.363612 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-9d467634-2659-4b98-b61d-0e1c1388206a tempest-AttachVolumeTestJSON-1773703291 tempest-AttachVolumeTestJSON-1773703291-project] 10.222.0.26 "GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a" status: 404 len: 111 microversion: 2.1 time: 0.029932 Jun 23 13:51:17.363612 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 544/1097] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Jun 23 13:51:17 2022] GET /compute/v2.1/servers/a45e14a5-376a-40fb-8ea0-934aa3de116a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:51:21.480830 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-ac4747aa-767d-4783-9e16-8beb55e61b85 tempest-VolumesGetTestJSON-1158224448 tempest-VolumesGetTestJSON-1158224448-project] Action: 'create', calling method: .version_select at 0x7fd7727a95e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1179404233", "metadata": {"Type": "work"}}} {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 13:51:21.796008 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-ac4747aa-767d-4783-9e16-8beb55e61b85 tempest-VolumesGetTestJSON-1158224448 tempest-VolumesGetTestJSON-1158224448-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.429199 Jun 23 13:51:21.796896 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 554/1098] 10.222.0.26 () {60 vars in 1155 bytes} [Thu Jun 23 13:51:21 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 431 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 23 13:51:21.807663 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-7f1b70cd-c6c4-4457-a55a-e05bb4b2a67c tempest-VolumesGetTestJSON-1158224448 tempest-VolumesGetTestJSON-1158224448-project] Calling method '.version_select at 0x7fd7724eee50>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:51:21.856362 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-7f1b70cd-c6c4-4457-a55a-e05bb4b2a67c tempest-VolumesGetTestJSON-1158224448 tempest-VolumesGetTestJSON-1158224448-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/20aa8619-85de-4bbf-8aa7-621b55d83db1" status: 200 len: 353 microversion: 2.1 time: 0.052568 Jun 23 13:51:21.856990 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 545/1099] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Jun 23 13:51:21 2022] GET /compute/v2.1/os-volumes/20aa8619-85de-4bbf-8aa7-621b55d83db1 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:51:22.874408 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-85792261-9abf-4c76-be49-ca6eb45fa449 tempest-VolumesGetTestJSON-1158224448 tempest-VolumesGetTestJSON-1158224448-project] Calling method '.version_select at 0x7fd7722e6a60>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:51:22.928426 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-85792261-9abf-4c76-be49-ca6eb45fa449 tempest-VolumesGetTestJSON-1158224448 tempest-VolumesGetTestJSON-1158224448-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/20aa8619-85de-4bbf-8aa7-621b55d83db1" status: 200 len: 354 microversion: 2.1 time: 0.061154 Jun 23 13:51:22.928987 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 555/1100] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Jun 23 13:51:22 2022] GET /compute/v2.1/os-volumes/20aa8619-85de-4bbf-8aa7-621b55d83db1 => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:51:22.940449 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-541001de-98b5-4531-a194-d625dfa04c37 tempest-VolumesGetTestJSON-1158224448 tempest-VolumesGetTestJSON-1158224448-project] Calling method '.version_select at 0x7fd77249f820>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:51:22.988651 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-541001de-98b5-4531-a194-d625dfa04c37 tempest-VolumesGetTestJSON-1158224448 tempest-VolumesGetTestJSON-1158224448-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/20aa8619-85de-4bbf-8aa7-621b55d83db1" status: 200 len: 354 microversion: 2.1 time: 0.052066 Jun 23 13:51:22.989485 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 546/1101] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Jun 23 13:51:22 2022] GET /compute/v2.1/os-volumes/20aa8619-85de-4bbf-8aa7-621b55d83db1 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:51:23.011116 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-5341874e-f251-46be-8287-694277ee6b34 tempest-VolumesGetTestJSON-1158224448 tempest-VolumesGetTestJSON-1158224448-project] Calling method '.version_select at 0x7fd77250dd30>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:51:23.084622 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-5341874e-f251-46be-8287-694277ee6b34 tempest-VolumesGetTestJSON-1158224448 tempest-VolumesGetTestJSON-1158224448-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/20aa8619-85de-4bbf-8aa7-621b55d83db1" status: 202 len: 0 microversion: 2.1 time: 0.077307 Jun 23 13:51:23.085291 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 556/1102] 10.222.0.26 () {58 vars in 1247 bytes} [Thu Jun 23 13:51:23 2022] DELETE /compute/v2.1/os-volumes/20aa8619-85de-4bbf-8aa7-621b55d83db1 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 13:51:23.093637 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: DEBUG nova.api.openstack.wsgi [None req-7728899f-37ed-4cfa-afc8-dbfbd97fea38 tempest-VolumesGetTestJSON-1158224448 tempest-VolumesGetTestJSON-1158224448-project] Calling method '.version_select at 0x7fd77237e280>' {{(pid=134666) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:51:23.141051 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO nova.api.openstack.requestlog [None req-7728899f-37ed-4cfa-afc8-dbfbd97fea38 tempest-VolumesGetTestJSON-1158224448 tempest-VolumesGetTestJSON-1158224448-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/20aa8619-85de-4bbf-8aa7-621b55d83db1" status: 200 len: 353 microversion: 2.1 time: 0.051551 Jun 23 13:51:23.141603 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: [pid: 134666|app: 0|req: 547/1103] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Jun 23 13:51:23 2022] GET /compute/v2.1/os-volumes/20aa8619-85de-4bbf-8aa7-621b55d83db1 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 13:51:24.154203 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-81372c7a-33d6-4335-9e84-9734128e2aed tempest-VolumesGetTestJSON-1158224448 tempest-VolumesGetTestJSON-1158224448-project] Calling method '.version_select at 0x7fd772617160>' {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 13:51:24.183209 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.wsgi [None req-81372c7a-33d6-4335-9e84-9734128e2aed tempest-VolumesGetTestJSON-1158224448 tempest-VolumesGetTestJSON-1158224448-project] HTTP exception thrown: Volume 20aa8619-85de-4bbf-8aa7-621b55d83db1 could not be found. Jun 23 13:51:24.185230 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-81372c7a-33d6-4335-9e84-9734128e2aed tempest-VolumesGetTestJSON-1158224448 tempest-VolumesGetTestJSON-1158224448-project] Request method failure captured: Jun 23 13:51:24.185230 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: request: GET /compute/v2.1/os-volumes/20aa8619-85de-4bbf-8aa7-621b55d83db1 HTTP/1.1 Jun 23 13:51:24.185230 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept: application/json Jun 23 13:51:24.185230 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Accept-Encoding: identity Jun 23 13:51:24.185230 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Connection: close Jun 23 13:51:24.185230 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Length: 0 Jun 23 13:51:24.185230 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Content-Type: application/json Jun 23 13:51:24.185230 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Host: 10.222.0.26 Jun 23 13:51:24.185230 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Openstack-System-Scope: None Jun 23 13:51:24.185230 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: User-Agent: python-urllib3/1.26.9 Jun 23 13:51:24.185230 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Auth-Token: gAAAAABitG_ZFAiXS2iR-YWSOeOCyLpc-9TRG-SCTEpzHYaMVPbNgMgvg5b5DU3_ybzqMhZ9QHUkwIZJWX8osDKMgSVSgUJixILsvLXJ7VIPukhg96Ixnuh-nf7IZ8neuw9ZWcyNJMGfcvZGyEu6mna_SxxX2smnbXcyxHAjp64VFuzLnULe8Rs Jun 23 13:51:24.185230 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Id: None Jun 23 13:51:24.185230 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Domain-Name: None Jun 23 13:51:24.185230 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Identity-Status: Confirmed Jun 23 13:51:24.185230 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Is-Admin-Project: True Jun 23 13:51:24.185230 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Id: default Jun 23 13:51:24.185230 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Domain-Name: Default Jun 23 13:51:24.185230 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Id: 5c24eb08d898421aa4e75fc3399cc3a7 Jun 23 13:51:24.185230 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Project-Name: tempest-VolumesGetTestJSON-1158224448 Jun 23 13:51:24.185230 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Role: member,reader Jun 23 13:51:24.185230 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Roles: member,reader Jun 23 13:51:24.186831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5c24eb08d898421aa4e75fc3399cc3a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c24eb08d898421aa4e75fc3399cc3a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c24eb08d898421aa4e75fc3399cc3a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5c24eb08d898421aa4e75fc3399cc3a7", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}] Jun 23 13:51:24.186831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant: tempest-VolumesGetTestJSON-1158224448 Jun 23 13:51:24.186831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Id: 5c24eb08d898421aa4e75fc3399cc3a7 Jun 23 13:51:24.186831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-Tenant-Name: tempest-VolumesGetTestJSON-1158224448 Jun 23 13:51:24.186831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User: tempest-VolumesGetTestJSON-1158224448-project Jun 23 13:51:24.186831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Id: default Jun 23 13:51:24.186831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Domain-Name: Default Jun 23 13:51:24.186831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Id: e6bdbf9a5d71400bb02f3a7a7eca2762 Jun 23 13:51:24.186831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: X-User-Name: tempest-VolumesGetTestJSON-1158224448-project Jun 23 13:51:24.186831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: method: Jun 23 13:51:24.186831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: exception: Volume 20aa8619-85de-4bbf-8aa7-621b55d83db1 could not be found. Jun 23 13:51:24.186831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: action_args: {'id': '20aa8619-85de-4bbf-8aa7-621b55d83db1'} Jun 23 13:51:24.186831 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: {{(pid=134667) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 13:51:24.188015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:51:24.188015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 13:51:24.188015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 13:51:24.188015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 13:51:24.188015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 13:51:24.188015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 13:51:24.188015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 13:51:24.188015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 13:51:24.188015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 13:51:24.188015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 13:51:24.188015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 13:51:24.188015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 13:51:24.188015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 13:51:24.188015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 13:51:24.188015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 13:51:24.188015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 20aa8619-85de-4bbf-8aa7-621b55d83db1 could not be found. (HTTP 404) (Request-ID: req-79f2f773-368e-407b-b3ba-12746d824b65) Jun 23 13:51:24.188015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:51:24.188015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:51:24.188015 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:51:24.189472 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:51:24.189472 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 13:51:24.189472 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 13:51:24.189472 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 13:51:24.189472 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 13:51:24.189472 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 13:51:24.189472 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 13:51:24.189472 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 13:51:24.189472 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 13:51:24.189472 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 13:51:24.189472 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 13:51:24.189472 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 13:51:24.189472 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 13:51:24.189472 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 13:51:24.189472 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 13:51:24.189472 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 13:51:24.189472 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 13:51:24.189472 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 13:51:24.189472 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 13:51:24.190856 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 13:51:24.190856 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 13:51:24.190856 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 13:51:24.190856 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 13:51:24.190856 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 20aa8619-85de-4bbf-8aa7-621b55d83db1 could not be found. Jun 23 13:51:24.190856 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:51:24.190856 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:51:24.190856 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:51:24.190856 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:51:24.190856 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:51:24.190856 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:51:24.190856 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 13:51:24.190856 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 13:51:24.190856 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 13:51:24.190856 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 13:51:24.190856 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 13:51:24.190856 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 13:51:24.190856 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 13:51:24.190856 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 13:51:24.192226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 20aa8619-85de-4bbf-8aa7-621b55d83db1 could not be found. Jun 23 13:51:24.192226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:51:24.192226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 13:51:24.192226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:51:24.192226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 13:51:24.192226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 13:51:24.192226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 13:51:24.192226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 13:51:24.192226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 13:51:24.192226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 20aa8619-85de-4bbf-8aa7-621b55d83db1 could not be found. Jun 23 13:51:24.192226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: ERROR nova.api.openstack.wsgi Jun 23 13:51:24.192226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: DEBUG nova.api.openstack.wsgi [None req-81372c7a-33d6-4335-9e84-9734128e2aed tempest-VolumesGetTestJSON-1158224448 tempest-VolumesGetTestJSON-1158224448-project] Returning 404 to user: Volume 20aa8619-85de-4bbf-8aa7-621b55d83db1 could not be found. {{(pid=134667) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 13:51:24.192226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO nova.api.openstack.requestlog [None req-81372c7a-33d6-4335-9e84-9734128e2aed tempest-VolumesGetTestJSON-1158224448 tempest-VolumesGetTestJSON-1158224448-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/20aa8619-85de-4bbf-8aa7-621b55d83db1" status: 404 len: 109 microversion: 2.1 time: 0.036851 Jun 23 13:51:24.192226 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: [pid: 134667|app: 0|req: 557/1104] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Jun 23 13:51:24 2022] GET /compute/v2.1/os-volumes/20aa8619-85de-4bbf-8aa7-621b55d83db1 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 13:52:41.086519 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 13:52:41.087679 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Thu Jun 23 13:52:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 13:52:53.906895 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 13:52:53.907887 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Thu Jun 23 13:52:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 13:54:33.841520 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 13:54:33.842335 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Thu Jun 23 13:54:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 13:56:01.103212 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 13:56:01.104374 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Thu Jun 23 13:56:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 13:56:13.921585 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 13:56:13.922769 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Thu Jun 23 13:56:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 13:56:14.638184 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 13:56:14.638511 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Thu Jun 23 13:56:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 13:56:28.478616 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 13:56:28.479673 dv-cinder-815582-10-iscsi devstack@n-api.service[134666]: Thu Jun 23 13:56:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 13:56:33.693843 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 13:56:33.694782 dv-cinder-815582-10-iscsi devstack@n-api.service[134667]: Thu Jun 23 13:56:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!